Here's the April-2017 list after two major replays due to an unsatisfying attempt to reduce time control to 900+2. I simply disliked mixing two TC's. Besides, seeing Komodo ranked lower than expected made me think i should rather go back to 900+1. Yes, i did this in weeks but the big surprise was that the lizard couldn't do better.
Anyways, it's Komodo 10.3 itself to blame possibly for a bad build. As i stated before, i'll miss Komodo 10.2 that reached 3390 ELO, close enough to SF8. Shame, that one is gone already.
Anyways, it's Komodo 10.3 itself to blame possibly for a bad build. As i stated before, i'll miss Komodo 10.2 that reached 3390 ELO, close enough to SF8. Shame, that one is gone already.
Nevertheless, i guess this release is the best Rapidroid ever, given that all 11 divisions contained 10 engines each without variations in number of games played. If you see some differences in the list, it's because of the manual games added at the final step.
I've tried to improve the calibration system as well. Now the arm build architecture is taken into account too.
And last but not least, all previous games played on Rockchip 3188 processor have been updated on Exynos 4412. Rapidroid is based on Exynos 4412 and Rockchip 3066 only now.
I hope to respect the restrictions of this test environment in future releases. Shortly said: all updates replace previous games and all impacted divisions are partly replayed in respect to 3 promotions and 3 relegations per division. This system is very demanding in terms of duration but the outcome looks accurate.
Regarding the ranking, numbers are speaking: Stockfish 8 is decisively the leader ahead of disappointing Komodo 10.3 while Chiron 4 is a nice surprise surpassing the old Critter at last!
Multicore Ivanhoe is also welcome with a significant boost.
And still no news of a Houdini for Android...
The highlights of this release:
* ADDED Nemorino 1.02.AP (2900 ELO!)
* UPDATED Arasan 18.3 to 20.0.AP
* UPDATED Bobcat 6.4b to 8.0.AP
* UPDATED Chiron 3 to 4
* UPDATED Crafty_25.0.JA_xb.arm7 to 256MB hash
* UPDATED Ethereal 7.78 to 8.05
* UPDATED Firenzina 2.4.1 xTreme to 2.4.3.AP
* UPDATED IvanHoe 9.47c beta to 1945a.AP
* UPDATED K2 v.083 to v0.87
* UPDATED Komodo 10 to 10.3
* UPDATED Laser_0.2beta.JA_uci2xb to 1.3 beta
* UPDATED Rhetoric 1.4.1 to 1.4.3
* UPDATED RobboLito 0.085e4l to 0.085g3l.AP
* UPDATED Rodent II 0.8.7 to II 0.9.68.AP
* UPDATED Sayuri 2016.04.09 to 2016.10.07.AP
* UPDATED Sting¨SF 4.8.4 JA to 7.3.AP
* UPDATED Stockfish 2016-07-16 to 8.AP
* UPDATED Texel 1.06 to 1.07a6
* UPDATED Zurichess¨Graubuenden to Jura
* DELETED Bison 15.1 (frequently exits)
* DELETED Bruja_1.9.1.JA_xb (bad terminations)
* DELETED Claudia¨v.¨0.5 (bad terminations)
* DELETED DanChess_1.04.JA_xb (bad terminations)
* DELETED Faile_1.44.JA_xb (bad terminations)
* DELETED Jester_0.84.JA_xb (bad terminations)
* DELETED Kitteneitor_060513.JA_xb (bad terminations)
* DELETED Knightcap_3.7F.JA_xb (bad terminations)
* DELETED MangoPaola_1.1.JA_xb (bad terminations)
* DELETED Micromax_4.8W.JA_xb (pratically same as FairyMax)
* DELETED Minimardi_1.3.AB_xb (bad terminations)
* DELETED MorphyChess_1.05.JA_xb (bad time usage)
* DELETED Natwarlal_0.14.JA_xb (bad terminations)
* DELETED Romichess_p3k.JA_xb (bad terminations)
* DELETED Samchess_JA_xb (bad terminations)
* DELETED Sjeng_1.12.JA_xb (bad terminations)
* DELETED Sungorus 1.4 JA (bad terminations)
* DELETED Typhoon_1.0.r358.JA_xb (bad terminations)
* DELETED Witz_Alpha21.JA_xb (bad terminations)
* DELETED Woodpecker_2.11.JA_xb (bad terminations)
Targets for next release:
* UPDATE Gull 3r5.JA to 3.AP
* UPDATE Ethereal 8.05 to 8.12
* UPDATE Rodent II 0.9.68 to III.0.171
* UPDATE Texel 1.07a6 to 1.07a9lazy
BAYES RATINGS AFTER 20099 GAMES PLAYED BY 124 PROGRAMS
Rnk Name O/S T TC Elo + - Gam Sco Oppo Dra
001 Stockfish 8.0.AP A32 4 bf 3442 42 39 360 89% 3117 21%
002 Komodo 10.3 A32 4 bf 3293 33 32 360 72% 3133 28%
003 Chiron 4 A32 4 bf 3167 30 30 360 55% 3139 38%
004 Critter 1.6a A32 4 bf 3138 29 29 368 53% 3128 45%
005 Firenzina 2.4.3 xTreme A32 4 bf 3136 30 30 360 53% 3125 41%
006 BlackMamba 2.0 A32 4 bf 3106 29 29 364 51% 3110 46%
007 Gull 3 x64 (syzygy) A32 4 bf 3105 31 30 360 57% 3058 38%
008 IvanHoe 1945a AP A32 4 bf 3093 30 30 360 49% 3103 46%
009 Sting SF 7.3 A32 4 bf 3092 30 30 360 48% 3110 41%
010 Rybka 2.3.2a mp W64 4 bf 3086 147 142 14 57% 3037 43%
011 Fritz 14 A32 4 bf 3086 30 30 360 49% 3095 43%
012 Texel 1.07a6 A32 4 bf 3068 30 30 360 49% 3075 37%
013 DeepSaros ver.2.3f A32 1 bf 3040 30 30 360 48% 3059 42%
014 Hiarcs 13.71 IOS 2 bf 3026 140 125 22 75% 2848 23%
015 Senpai 1.0 A32 4 bf 3009 31 31 366 51% 3008 30%
016 RobboLito 0.085g3l AP A32 1 bf 3007 29 29 360 52% 2992 46%
017 Cheng 4.39 A32 4 bf 2990 30 30 360 48% 3009 43%
018 Bobcat v8.0 AP A32 4 bf 2984 31 31 360 48% 3000 35%
019 Arasan 20.0 A32 4 bf 2983 30 30 360 50% 2985 40%
020 ExChess_7.88b.JA_xb.arm7 A32 4 b 2924 30 30 360 52% 2914 40%
021 Shredder 1.7.0 IOS 2 b 2903 123 122 20 53% 2892 45%
022 Gaviota v1.0-d A32 4 bf 2903 30 30 370 48% 2915 36%
023 Nemorino 1.02 AP A32 4 b 2900 31 31 360 45% 2933 34%
024 Hakkapeliitta 3.0 A32 1 bf 2895 31 31 362 53% 2873 32%
025 Scorpio_2.7.7.JA_xb.arm7 A32 4 bf 2867 30 30 360 49% 2870 33%
026 Grapefruit 1.0 A32 4 bf 2860 30 30 374 46% 2886 37%
027 Toga II 3.0 A32 1 bf 2839 30 30 362 47% 2864 35%
028 DiscoCheck 5.2.1 A32 1 bf 2838 30 30 374 50% 2835 33%
029 Deep Saros 0.9 A32 4 bf 2825 29 29 372 50% 2824 39%
030 Laser 1.3 beta A32 4 b 2799 31 31 360 47% 2820 33%
031 Rodent II 0.9.68 A32 1 b 2797 30 30 360 50% 2801 33%
032 Crafty_25.0.JA_xb.arm7.pie A32 1 bf 2785 31 31 360 48% 2802 27%
033 Doch32 1.3.4 JA A32 1 b 2778 30 30 378 50% 2779 36%
034 Fruit Reloaded 2.1 A32 1 b 2774 29 29 376 51% 2766 38%
035 Chess Pro 2016.02 IOS 2 bf 2761 111 113 22 45% 2791 55%
036 Murka 3 A32 1 bf 2759 29 29 386 49% 2772 33%
037 GNU Chess 5.60 A32 1 bf 2755 30 30 364 54% 2730 31%
038 Deuterium v14.3.34.130 A32 1 bf 2751 29 29 378 51% 2741 40%
039 Strelka 5 A32 1 bf 2732 30 30 364 52% 2713 31%
040 The King 3.50 x64 W64 1 b 2728 56 58 98 40% 2791 36%
041 Zurichess Jura A32 1 b 2699 31 31 360 53% 2673 32%
042 Tucano_6.00.JA_xb.arm5 A32 1 bf 2693 30 30 360 51% 2677 35%
043 RedQueen 1.1.98 A32 4 bf 2686 31 31 360 50% 2686 31%
044 CNVCS 1.2.0 IOS 2 f 2655 114 117 22 43% 2694 50%
045 Alfil 12.10 A32 1 bf 2649 31 31 362 50% 2647 25%
046 Pawny 1.2 A32 1 bf 2645 31 31 360 47% 2670 28%
047 Rhetoric 1.4.3 A32 1 bf 2639 31 31 360 53% 2616 30%
048 Rodin v8.00 A32 1 bf 2627 31 31 360 49% 2633 28%
049 Daydreamer 1.75 JA A32 1 bf 2609 30 30 364 49% 2614 33%
050 Cheese 1.8 A32 1 bf 2602 31 31 360 51% 2594 30%
051 Chess Genius 4.0.00 IOS 2 bf 2582 196 253 8 13% 2837 25%
052 Chess Genius 2.6.4 A32 1 bf 2580 224 239 4 38% 2629 75%
053 Glaurung Mainz A32 1 b 2563 31 31 360 55% 2525 31%
054 Phalanx_XXIV.JA_xb.arm7 A32 1 bf 2561 31 31 360 48% 2577 28%
055 K2 v.087 A32 1 b 2552 32 31 360 54% 2511 28%
056 GarboChess 3 A32 1 bf 2545 31 31 362 51% 2536 27%
057 Rotor 0.8 A32 1 bf 2539 31 31 362 50% 2532 28%
058 Sloppy_0.23.JA_xb A32 1 bf 2527 31 31 360 50% 2522 28%
059 Fridolin 2.00 A32 4 bf 2509 31 31 360 51% 2499 27%
060 Maverick 1.5 arm A32 1 bf 2505 32 32 360 55% 2464 25%
061 Ethereal 8.05 A32 1 b 2504 32 32 360 54% 2473 23%
062 GreKo_2015.JA_xb A32 1 bf 2492 31 32 360 47% 2504 26%
063 DanaSah 6.1 A32 1 bf 2491 31 31 360 48% 2501 27%
064 Dirty_030411.JA_xb A32 1 bf 2490 31 31 360 48% 2491 28%
065 BBChess 1.3b JA A32 4 bf 2487 31 32 362 47% 2510 23%
066 Pepito v1.59 A32 1 bf 2449 32 32 360 51% 2437 24%
067 Ifrit_m1.8.JA_uci2xb A32 1 Bf 2411 32 32 360 52% 2388 24%
068 BetsabeII_1.47.JA_xb A32 1 bf 2401 33 33 360 51% 2387 20%
069 Diablo 0.5.1b JA A32 1 bf 2369 33 33 360 49% 2374 22%
070 Olithink_5.3.2.JA_xb A32 1 bf 2349 34 33 360 54% 2314 20%
071 Amy_0.8.JA_xb A32 1 bf 2346 34 34 360 54% 2314 12%
072 TJchess 1.1U A32 1 bf 2267 33 33 360 50% 2265 18%
073 Bitfoot 150922.JA A32 1 bf 2242 34 34 360 50% 2244 14%
074 Myrddin_0.86.JA_xb A32 1 bf 2229 33 33 360 49% 2241 17%
075 Beowulf_2.4a.JA_xb A32 1 b 2205 33 33 360 46% 2233 18%
076 Rattate_Nosferatu.JA_xb A32 1 bf 2188 33 33 360 47% 2217 17%
077 KmtChess_1.21.JA_xb A32 1 bf 2151 33 33 360 46% 2187 20%
078 Resp_0.19.JA_xb A32 1 bf 2145 33 33 360 52% 2132 21%
079 Scidlet_2.61b2.JA_xb A32 1 bf 2136 33 33 360 47% 2165 18%
080 Floyd 0.7 JA A32 1 bf 2106 33 33 360 52% 2094 17%
081 AnkanChess 0.0 A32 1 b 2081 33 33 360 51% 2073 18%
082 Robocide 28.12.14.JA A32 1 bf 2070 32 32 388 49% 2079 17%
083 Gk_0.90.JA_xb A32 1 b 2057 33 33 360 51% 2053 19%
084 Kurt 0.9.2.2 JA A32 1 bf 2053 33 32 360 50% 2054 22%
085 Cinnamon 2.0 A32 4 bf 2026 33 32 360 53% 2010 22%
086 NGplay_9.86.JA_xb A32 1 bf 2017 32 32 360 48% 2032 21%
087 Sunsetter_C10.JA_xb A32 1 b 2013 33 33 360 47% 2035 19%
088 Gunborg_1.39.JA_uci2xb A32 1 bf 1998 32 32 360 49% 2010 25%
089 BikJump v1.8 A32 1 bf 1949 31 31 388 51% 1939 22%
090 Soldat-III_0.178.JA_xb A32 1 b 1934 33 33 360 51% 1922 18%
091 AdroitChess0.4 JA A32 1 bf 1916 35 35 360 54% 1879 12%
092 Gullydeckel_2.15.pl10.JA_xb A32 1 b 1914 33 33 360 47% 1930 16%
093 Mephisto Roma Turbo W64 1 b 1906 80 84 56 37% 2009 16%
094 Cilian_4.14.JA_xb A32 1 bf 1889 33 33 360 53% 1853 23%
095 Fairymax_4.8V.JA_xb A32 1 b 1886 32 32 360 49% 1889 22%
096 ZCT-0.3.2500 A32 1 bf 1885 33 33 360 49% 1890 14%
097 Leonidas_r83.JA_xb A32 1 Bf 1875 33 33 360 46% 1904 15%
098 Colchess_8.0.JA_xb A32 1 Bf 1864 33 33 360 55% 1816 21%
099 Ecce rev. 508 A32 1 bf 1836 35 34 360 53% 1805 13%
100 Sayuri 2016.10.07 A32 4 bf 1823 34 34 360 54% 1789 17%
101 Smash 1.03 JA A32 1 bf 1806 34 34 370 53% 1771 14%
102 Surprise_4.3.b13.JA_xb A32 1 b 1725 35 36 360 51% 1699 14%
103 Hoichess_0.12.1.JA_xb A32 1 bf 1683 35 35 360 51% 1659 16%
104 Chenard_2015.08.15.JA_xb A32 1 bf 1648 34 34 360 52% 1611 14%
105 Tscp_1.8.1.AB_xb A32 1 bf 1628 35 35 360 52% 1587 16%
106 Zzzzzz_3.5.1.JA_xb A32 1 bf 1602 34 34 360 52% 1553 23%
107 Rocinante 2.0 JA A32 1 bf 1590 38 38 360 56% 1462 11%
108 Darky_0.5d.JA_xb A32 1 b 1532 37 37 360 51% 1462 16%
109 Colossus 4.0 100X C64 1 bf 1530 277 235 8 88% 1106 25%
110 Mephisto Roma 68020 UCI W64 1 b 1508 132 141 20 35% 1627 30%
111 Pulse 1.5-cpp A32 1 bf 1448 37 37 374 53% 1344 25%
112 VIRUTOR CHESS 1.1.1 A32 1 bf 1437 39 40 366 51% 1368 13%
113 Mizar_3.0.JA_xb A32 1 b 1414 41 42 360 51% 1346 11%
114 Chess for Android A32 1 bf 1350 41 41 363 56% 1221 13%
115 Superpawn b108 JA A32 1 b 1277 40 40 360 59% 1127 18%
116 Chess Titans W64 1 f 1245 216 204 7 57% 1216 29%
117 Toledo_Nano_2010.JA_xb A32 1 b 1088 38 39 360 49% 1061 23%
118 Trappy_Beowulf_2.0.JA_xb A32 1 bf 1081 40 40 366 49% 1061 11%
119 Colossus 4.0 C64 1 bf 1061 175 123 14 36% 1157 14%
120 Xadreco_5.7.JA_xb A32 1 b 949 43 23 360 36% 1076 11%
121 Byak 8.10.14.JA A32 1 b 929 45 5 366 35% 1079 21%
122 Novag Secondo TTC 1 bf 831 309 -95 6 42% 873 17%
123 OliveChess 0.2.7 A32 1 bf 608 324-315 366 13% 1114 4%
124 DanaSah 6.0 RND A32 1 bf 277 653-646 360 1% 1151 3%
Rapidroid test platform:
* GT-N7100 1.6 * 4 + 256MB hash: All Android progs
* GT-N5105 1.6 * 4 + 256MB hash: All Android progs
* Codegen Novatab 1.4 * 4 + 256MB: Single thread Android progs,
* Polypad 1010IPS tablet 1.61 * 2 + 128MB: Single thread Android progs
* HTC Diam 528Mhz, 16MB hash: Windows Mobile
* i7 M620 2.67 Ghz dual + Arena 3.5 + 2GB hash: Windows 64
* iPhone5S A7 1.3 Ghz * 2: iOS progs
* DosBox 1.74: DOS progs
* WinVICE 2.24: Commodore-64 progs
* Messtiny UCI adapters or CB-Emu2014: Mephisto progs
* Openings: 20 ply Adam Hair or 16 ply TCEC, no Q exchange, +0.15 to +0.40
eval by Stockfish and Komodo, depth 20 minimum, played twice both sides
* Repeating openings and twin games not allowed between two programs
* Tablebases off and pondering off
* Time control: 600+0 to 1800+5 (optional 1/10 to 1/30 for manual games)
Calibration:
* Based on 42 engines rated in CCRL 40/4
* 32 bit arm5 vs CCRL 32-bit: Exynos 4412 = (Athlon X2 4600+) - 95 ELO
* 32 bit arm5 vs CCRL 64-bit: Exynos 4412 = (Athlon X2 4600+) - 118 ELO
* 32 bit arm7 vs CCRL 32-bit: Exynos 4412 = (Athlon X2 4600+) - 60 ELO
* 32 bit arm7 vs CCRL 64-bit: Exynos 4412 = (Athlon X2 4600+) - 83 ELO
* Bayeselo offset = 2312 (Mean of ELO error vs target: 46.9)
Termination stats:
* W:41.1% D:25.7% B:33.2% (54.0% vs 46.0%)
Legend:
* T = threads
* tc= f (playes fixed time only), b (plays Fischer clock only), bf (plays both)
* O/S: A32=Android 32bit, W64=Windows 64bit, C64=Commodore 64, TTC=Tabletop, IOS=iPhone
Good job Gurcan! Big disappointment by K 10.3, but very nice performance by Chiron! Thanks.
ReplyDeleteStockfish 8.0.AP, pgo or normal arm7?
ReplyDeleteIt's the pgo version.
DeleteI'm happy for Ivanhoe 1945a,
ReplyDeleteprogress of about 100 elo compared
to Ivanhoe 9.47.
Yes indeed. 4 threads with 256MB hash have finally come together in one build.
DeleteOur friend Javier has released new app, Chess Engines Tournament in Google Play Store.
ReplyDelete