HAL9000

HAL9000
"It just isn't conceivable that you can design a program strong enough to beat players like me."

April 24, 2017

RAPIDROID RELOADED: April-2017 ft Stockfish 8, Komodo 10.3 and Chiron 4

Here's the April-2017 list after two major replays due to an unsatisfying attempt to reduce time control to 900+2. I simply disliked mixing two TC's. Besides, seeing Komodo ranked lower than expected made me think i should rather go back to 900+1. Yes, i did this in weeks but the big surprise was that the lizard couldn't do better.

Anyways, it's Komodo 10.3 itself to blame possibly for a bad build. As i stated before, i'll miss Komodo 10.2 that reached 3390 ELO, close enough to SF8. Shame, that one is gone already.

Nevertheless, i guess this release is the best Rapidroid ever, given that all 11 divisions contained 10 engines each without variations in number of games played. If you see some differences in the list, it's because of the manual games added at the final step.

I've tried to improve the calibration system as well. Now the arm build architecture is taken into account too.

And last but not least, all previous games played on Rockchip 3188 processor have been updated on Exynos 4412. Rapidroid is based on Exynos 4412 and Rockchip 3066 only now.

I hope to respect the restrictions of this test environment in future releases. Shortly said: all updates replace previous games and all impacted divisions are partly replayed in respect to 3 promotions and 3 relegations per division. This system is very demanding in terms of duration but the outcome looks accurate.

Regarding the ranking, numbers are speaking: Stockfish 8 is decisively the leader ahead of disappointing Komodo 10.3 while Chiron 4 is a nice surprise surpassing the old Critter at last!

Multicore Ivanhoe is also welcome with a significant boost.

And still no news of a Houdini for Android...

The highlights of this release:
* ADDED Nemorino 1.02.AP (2900 ELO!)
* UPDATED Arasan 18.3 to 20.0.AP
* UPDATED Bobcat 6.4b to 8.0.AP
* UPDATED Chiron 3 to 4
* UPDATED Crafty_25.0.JA_xb.arm7 to 256MB hash
* UPDATED Ethereal 7.78 to 8.05
* UPDATED Firenzina 2.4.1 xTreme to 2.4.3.AP
* UPDATED IvanHoe 9.47c beta to 1945a.AP
* UPDATED K2 v.083 to v0.87
* UPDATED Komodo 10 to 10.3
* UPDATED Laser_0.2beta.JA_uci2xb to 1.3 beta
* UPDATED Rhetoric 1.4.1 to 1.4.3
* UPDATED RobboLito 0.085e4l to 0.085g3l.AP
* UPDATED Rodent II 0.8.7 to II 0.9.68.AP
* UPDATED Sayuri 2016.04.09 to 2016.10.07.AP
* UPDATED Sting¨SF 4.8.4 JA to 7.3.AP
* UPDATED Stockfish 2016-07-16 to 8.AP
* UPDATED Texel 1.06 to 1.07a6
* UPDATED Zurichess¨Graubuenden to Jura
* DELETED Bison 15.1 (frequently exits)
* DELETED Bruja_1.9.1.JA_xb (bad terminations)
* DELETED Claudia¨v.¨0.5 (bad terminations)
* DELETED DanChess_1.04.JA_xb (bad terminations)
* DELETED Faile_1.44.JA_xb (bad terminations)
* DELETED Jester_0.84.JA_xb (bad terminations)
* DELETED Kitteneitor_060513.JA_xb (bad terminations)
* DELETED Knightcap_3.7F.JA_xb (bad terminations)
* DELETED MangoPaola_1.1.JA_xb (bad terminations)
* DELETED Micromax_4.8W.JA_xb (pratically same as FairyMax)
* DELETED Minimardi_1.3.AB_xb (bad terminations)
* DELETED MorphyChess_1.05.JA_xb (bad time usage)
* DELETED Natwarlal_0.14.JA_xb (bad terminations)
* DELETED Romichess_p3k.JA_xb (bad terminations)
* DELETED Samchess_JA_xb (bad terminations)
* DELETED Sjeng_1.12.JA_xb (bad terminations)
* DELETED Sungorus 1.4 JA (bad terminations)
* DELETED Typhoon_1.0.r358.JA_xb (bad terminations)
* DELETED Witz_Alpha21.JA_xb (bad terminations)
* DELETED Woodpecker_2.11.JA_xb (bad terminations)

Targets for next release:
* UPDATE Gull 3r5.JA to 3.AP
* UPDATE Ethereal 8.05 to 8.12
* UPDATE Rodent II 0.9.68 to III.0.171
* UPDATE Texel 1.07a6 to 1.07a9lazy

BAYES RATINGS AFTER 20099 GAMES PLAYED BY 124 PROGRAMS
Rnk Name                        O/S T TC  Elo   +   - Gam Sco Oppo Dra
001 Stockfish 8.0.AP            A32 4 bf 3442  42  39 360 89% 3117 21%
002 Komodo 10.3                 A32 4 bf 3293  33  32 360 72% 3133 28%
003 Chiron 4                    A32 4 bf 3167  30  30 360 55% 3139 38%
004 Critter 1.6a                A32 4 bf 3138  29  29 368 53% 3128 45%
005 Firenzina 2.4.3 xTreme      A32 4 bf 3136  30  30 360 53% 3125 41%
006 BlackMamba 2.0              A32 4 bf 3106  29  29 364 51% 3110 46%
007 Gull 3 x64 (syzygy)         A32 4 bf 3105  31  30 360 57% 3058 38%
008 IvanHoe 1945a AP            A32 4 bf 3093  30  30 360 49% 3103 46%
009 Sting SF 7.3                A32 4 bf 3092  30  30 360 48% 3110 41%
010 Rybka 2.3.2a mp             W64 4 bf 3086 147 142  14 57% 3037 43%
011 Fritz 14                    A32 4 bf 3086  30  30 360 49% 3095 43%
012 Texel 1.07a6                A32 4 bf 3068  30  30 360 49% 3075 37%
013 DeepSaros ver.2.3f          A32 1 bf 3040  30  30 360 48% 3059 42%
014 Hiarcs 13.71                IOS 2 bf 3026 140 125  22 75% 2848 23%
015 Senpai 1.0                  A32 4 bf 3009  31  31 366 51% 3008 30%
016 RobboLito 0.085g3l AP       A32 1 bf 3007  29  29 360 52% 2992 46%
017 Cheng 4.39                  A32 4 bf 2990  30  30 360 48% 3009 43%
018 Bobcat v8.0 AP              A32 4 bf 2984  31  31 360 48% 3000 35%
019 Arasan 20.0                 A32 4 bf 2983  30  30 360 50% 2985 40%
020 ExChess_7.88b.JA_xb.arm7    A32 4  b 2924  30  30 360 52% 2914 40%
021 Shredder 1.7.0              IOS 2  b 2903 123 122  20 53% 2892 45%
022 Gaviota v1.0-d              A32 4 bf 2903  30  30 370 48% 2915 36%
023 Nemorino 1.02 AP            A32 4  b 2900  31  31 360 45% 2933 34%
024 Hakkapeliitta 3.0           A32 1 bf 2895  31  31 362 53% 2873 32%
025 Scorpio_2.7.7.JA_xb.arm7    A32 4 bf 2867  30  30 360 49% 2870 33%
026 Grapefruit 1.0              A32 4 bf 2860  30  30 374 46% 2886 37%
027 Toga II 3.0                 A32 1 bf 2839  30  30 362 47% 2864 35%
028 DiscoCheck 5.2.1            A32 1 bf 2838  30  30 374 50% 2835 33%
029 Deep Saros 0.9              A32 4 bf 2825  29  29 372 50% 2824 39%
030 Laser 1.3 beta              A32 4  b 2799  31  31 360 47% 2820 33%
031 Rodent II 0.9.68            A32 1  b 2797  30  30 360 50% 2801 33%
032 Crafty_25.0.JA_xb.arm7.pie  A32 1 bf 2785  31  31 360 48% 2802 27%
033 Doch32 1.3.4 JA             A32 1  b 2778  30  30 378 50% 2779 36%
034 Fruit Reloaded 2.1          A32 1  b 2774  29  29 376 51% 2766 38%
035 Chess Pro 2016.02           IOS 2 bf 2761 111 113  22 45% 2791 55%
036 Murka 3                     A32 1 bf 2759  29  29 386 49% 2772 33%
037 GNU Chess 5.60              A32 1 bf 2755  30  30 364 54% 2730 31%
038 Deuterium v14.3.34.130      A32 1 bf 2751  29  29 378 51% 2741 40%
039 Strelka 5                   A32 1 bf 2732  30  30 364 52% 2713 31%
040 The King 3.50 x64           W64 1  b 2728  56  58  98 40% 2791 36%
041 Zurichess Jura              A32 1  b 2699  31  31 360 53% 2673 32%
042 Tucano_6.00.JA_xb.arm5      A32 1 bf 2693  30  30 360 51% 2677 35%
043 RedQueen 1.1.98             A32 4 bf 2686  31  31 360 50% 2686 31%
044 CNVCS 1.2.0                 IOS 2  f 2655 114 117  22 43% 2694 50%
045 Alfil 12.10                 A32 1 bf 2649  31  31 362 50% 2647 25%
046 Pawny 1.2                   A32 1 bf 2645  31  31 360 47% 2670 28%
047 Rhetoric 1.4.3              A32 1 bf 2639  31  31 360 53% 2616 30%
048 Rodin v8.00                 A32 1 bf 2627  31  31 360 49% 2633 28%
049 Daydreamer 1.75 JA          A32 1 bf 2609  30  30 364 49% 2614 33%
050 Cheese 1.8                  A32 1 bf 2602  31  31 360 51% 2594 30%
051 Chess Genius 4.0.00         IOS 2 bf 2582 196 253   8 13% 2837 25%
052 Chess Genius 2.6.4          A32 1 bf 2580 224 239   4 38% 2629 75%
053 Glaurung Mainz              A32 1  b 2563  31  31 360 55% 2525 31%
054 Phalanx_XXIV.JA_xb.arm7     A32 1 bf 2561  31  31 360 48% 2577 28%
055 K2 v.087                    A32 1  b 2552  32  31 360 54% 2511 28%
056 GarboChess 3                A32 1 bf 2545  31  31 362 51% 2536 27%
057 Rotor 0.8                   A32 1 bf 2539  31  31 362 50% 2532 28%
058 Sloppy_0.23.JA_xb           A32 1 bf 2527  31  31 360 50% 2522 28%
059 Fridolin 2.00               A32 4 bf 2509  31  31 360 51% 2499 27%
060 Maverick 1.5 arm            A32 1 bf 2505  32  32 360 55% 2464 25%
061 Ethereal 8.05               A32 1  b 2504  32  32 360 54% 2473 23%
062 GreKo_2015.JA_xb            A32 1 bf 2492  31  32 360 47% 2504 26%
063 DanaSah 6.1                 A32 1 bf 2491  31  31 360 48% 2501 27%
064 Dirty_030411.JA_xb          A32 1 bf 2490  31  31 360 48% 2491 28%
065 BBChess 1.3b JA             A32 4 bf 2487  31  32 362 47% 2510 23%
066 Pepito v1.59                A32 1 bf 2449  32  32 360 51% 2437 24%
067 Ifrit_m1.8.JA_uci2xb        A32 1 Bf 2411  32  32 360 52% 2388 24%
068 BetsabeII_1.47.JA_xb        A32 1 bf 2401  33  33 360 51% 2387 20%
069 Diablo 0.5.1b JA            A32 1 bf 2369  33  33 360 49% 2374 22%
070 Olithink_5.3.2.JA_xb        A32 1 bf 2349  34  33 360 54% 2314 20%
071 Amy_0.8.JA_xb               A32 1 bf 2346  34  34 360 54% 2314 12%
072 TJchess 1.1U                A32 1 bf 2267  33  33 360 50% 2265 18%
073 Bitfoot 150922.JA           A32 1 bf 2242  34  34 360 50% 2244 14%
074 Myrddin_0.86.JA_xb          A32 1 bf 2229  33  33 360 49% 2241 17%
075 Beowulf_2.4a.JA_xb          A32 1  b 2205  33  33 360 46% 2233 18%
076 Rattate_Nosferatu.JA_xb     A32 1 bf 2188  33  33 360 47% 2217 17%
077 KmtChess_1.21.JA_xb         A32 1 bf 2151  33  33 360 46% 2187 20%
078 Resp_0.19.JA_xb             A32 1 bf 2145  33  33 360 52% 2132 21%
079 Scidlet_2.61b2.JA_xb        A32 1 bf 2136  33  33 360 47% 2165 18%
080 Floyd 0.7 JA                A32 1 bf 2106  33  33 360 52% 2094 17%
081 AnkanChess 0.0              A32 1  b 2081  33  33 360 51% 2073 18%
082 Robocide 28.12.14.JA        A32 1 bf 2070  32  32 388 49% 2079 17%
083 Gk_0.90.JA_xb               A32 1  b 2057  33  33 360 51% 2053 19%
084 Kurt 0.9.2.2 JA             A32 1 bf 2053  33  32 360 50% 2054 22%
085 Cinnamon 2.0                A32 4 bf 2026  33  32 360 53% 2010 22%
086 NGplay_9.86.JA_xb           A32 1 bf 2017  32  32 360 48% 2032 21%
087 Sunsetter_C10.JA_xb         A32 1  b 2013  33  33 360 47% 2035 19%
088 Gunborg_1.39.JA_uci2xb      A32 1 bf 1998  32  32 360 49% 2010 25%
089 BikJump v1.8                A32 1 bf 1949  31  31 388 51% 1939 22%
090 Soldat-III_0.178.JA_xb      A32 1  b 1934  33  33 360 51% 1922 18%
091 AdroitChess0.4 JA           A32 1 bf 1916  35  35 360 54% 1879 12%
092 Gullydeckel_2.15.pl10.JA_xb A32 1  b 1914  33  33 360 47% 1930 16%
093 Mephisto Roma Turbo         W64 1  b 1906  80  84  56 37% 2009 16%
094 Cilian_4.14.JA_xb           A32 1 bf 1889  33  33 360 53% 1853 23%
095 Fairymax_4.8V.JA_xb         A32 1  b 1886  32  32 360 49% 1889 22%
096 ZCT-0.3.2500                A32 1 bf 1885  33  33 360 49% 1890 14%
097 Leonidas_r83.JA_xb          A32 1 Bf 1875  33  33 360 46% 1904 15%
098 Colchess_8.0.JA_xb          A32 1 Bf 1864  33  33 360 55% 1816 21%
099 Ecce rev. 508               A32 1 bf 1836  35  34 360 53% 1805 13%
100 Sayuri 2016.10.07           A32 4 bf 1823  34  34 360 54% 1789 17%
101 Smash 1.03 JA               A32 1 bf 1806  34  34 370 53% 1771 14%
102 Surprise_4.3.b13.JA_xb      A32 1  b 1725  35  36 360 51% 1699 14%
103 Hoichess_0.12.1.JA_xb       A32 1 bf 1683  35  35 360 51% 1659 16%
104 Chenard_2015.08.15.JA_xb    A32 1 bf 1648  34  34 360 52% 1611 14%
105 Tscp_1.8.1.AB_xb            A32 1 bf 1628  35  35 360 52% 1587 16%
106 Zzzzzz_3.5.1.JA_xb          A32 1 bf 1602  34  34 360 52% 1553 23%
107 Rocinante 2.0 JA            A32 1 bf 1590  38  38 360 56% 1462 11%
108 Darky_0.5d.JA_xb            A32 1  b 1532  37  37 360 51% 1462 16%
109 Colossus 4.0 100X           C64 1 bf 1530 277 235   8 88% 1106 25%
110 Mephisto Roma 68020 UCI     W64 1  b 1508 132 141  20 35% 1627 30%
111 Pulse 1.5-cpp               A32 1 bf 1448  37  37 374 53% 1344 25%
112 VIRUTOR CHESS 1.1.1         A32 1 bf 1437  39  40 366 51% 1368 13%
113 Mizar_3.0.JA_xb             A32 1  b 1414  41  42 360 51% 1346 11%
114 Chess for Android           A32 1 bf 1350  41  41 363 56% 1221 13%
115 Superpawn b108 JA           A32 1  b 1277  40  40 360 59% 1127 18%
116 Chess Titans                W64 1  f 1245 216 204   7 57% 1216 29%
117 Toledo_Nano_2010.JA_xb      A32 1  b 1088  38  39 360 49% 1061 23%
118 Trappy_Beowulf_2.0.JA_xb    A32 1 bf 1081  40  40 366 49% 1061 11%
119 Colossus 4.0                C64 1 bf 1061 175 123  14 36% 1157 14%
120 Xadreco_5.7.JA_xb           A32 1  b  949  43  23 360 36% 1076 11%
121 Byak 8.10.14.JA             A32 1  b  929  45   5 366 35% 1079 21%
122 Novag Secondo               TTC 1 bf  831 309 -95   6 42%  873 17%
123 OliveChess 0.2.7            A32 1 bf  608 324-315 366 13% 1114  4%
124 DanaSah 6.0 RND             A32 1 bf  277 653-646 360  1% 1151  3%

Rapidroid test platform:
* GT-N7100 1.6 * 4 + 256MB hash: All Android progs
* GT-N5105 1.6 * 4 + 256MB hash: All Android progs
* Codegen Novatab 1.4 * 4 + 256MB: Single thread Android progs,
* Polypad 1010IPS tablet 1.61 * 2 + 128MB: Single thread Android progs
* HTC Diam 528Mhz, 16MB hash: Windows Mobile
* i7 M620 2.67 Ghz dual + Arena 3.5 + 2GB hash: Windows 64
* iPhone5S A7 1.3 Ghz * 2: iOS progs
* DosBox 1.74: DOS progs
* WinVICE 2.24: Commodore-64 progs
* Messtiny UCI adapters or CB-Emu2014: Mephisto progs
* Openings: 20 ply Adam Hair or 16 ply TCEC, no Q exchange, +0.15 to +0.40
eval by Stockfish and Komodo, depth 20 minimum, played twice both sides
* Repeating openings and twin games not allowed between two programs
* Tablebases off and pondering off
* Time control: 600+0 to 1800+5 (optional 1/10 to 1/30 for manual games)

Calibration:
* Based on 42 engines rated in CCRL 40/4
* 32 bit arm5 vs CCRL 32-bit: Exynos 4412 = (Athlon X2 4600+) - 95 ELO
* 32 bit arm5 vs CCRL 64-bit: Exynos 4412 = (Athlon X2 4600+) - 118 ELO
* 32 bit arm7 vs CCRL 32-bit: Exynos 4412 = (Athlon X2 4600+) - 60 ELO
* 32 bit arm7 vs CCRL 64-bit: Exynos 4412 = (Athlon X2 4600+) - 83 ELO
* Bayeselo offset = 2312 (Mean of ELO error vs target: 46.9)

Termination stats:
* W:41.1% D:25.7% B:33.2% (54.0% vs 46.0%)

Legend:
* T = threads
* tc= f (playes fixed time only), b (plays Fischer clock only), bf (plays both)
* O/S: A32=Android 32bit, W64=Windows 64bit, C64=Commodore 64, TTC=Tabletop, IOS=iPhone

6 comments:

Alex said...

Good job Gurcan! Big disappointment by K 10.3, but very nice performance by Chiron! Thanks.

Anonymous said...

Stockfish 8.0.AP, pgo or normal arm7?

Alexei Chernakoff said...

I'm happy for Ivanhoe 1945a,
progress of about 100 elo compared
to Ivanhoe 9.47.

Unknown said...

It's the pgo version.

Unknown said...

Yes indeed. 4 threads with 256MB hash have finally come together in one build.

Alex said...

Our friend Javier has released new app, Chess Engines Tournament in Google Play Store.