October 4, 2015

RAPIDROID RELOADED: September-2015 with Komodo 9.2


Although this release took a few days of delay, it was just because of a hard working week. Anyway, i believe the improvements compensate largely.

The highlights of this release are:
* UPDATED Komodo 9.1 to Komodo 9.2
* UPDATED Zurichess Basel to Zurichess Fribourg
* ADDED Fridolin 2.0.0
* ADDED Rybka 2.3.2a MP as new Windows engine
* ADDED The King 3.50 x64 as new Windows engine
* ADDED Novag Secondo as first tabletop computer engine
* ADDED 50 ELO to all Android engines for better calibration

THE TOPPER:

Komodo 9.2 is clearly stronger than 9.1, in contrast to my initial expectations. After a short hesitation, i replayed all previous Komodo games and 9.2 proved itself. It seems the reptile will stick to the top for a while, at least until Stockfish 7 kicks in.

As mentioned previously, the list needs good calibration vs CCRL and SSDF to be as readable as possible. I always knew it's very complex without the same hardware configuration for Windows engines and use them as trustable calibers.

AMD Athlon x2 4600+ used by CCRL and Intel Quad Core Q6600 used by SSDF have both disappeared. The only solution remaining is to find an acceptable correlation between my Intel Core i7-620M, which has also disappeared from the market long ago.

Past comparisons in benchmarking sites and some available tools show that i7-620M performs better than Athlon and slightly lower than Q6600 with MP. Therefore Windows engines must collect as much ELO as in CCRL but not more than SSDF when tested against Android engines, simply and logically.

Remote connection feature of Chess for Android worked well between Samsung Galaxy Note II and my notebook except for the gauntlets. No way to run like this.

I've had to alter my pairing method to increase automation, by playing vs each Android opponent one by one in separate gauntlets using a collection of related openings instead of consecutive rounds with various opponents using same opening for whole round.

The network engine feature works okay but needs improvement to become more effective. That's a topic i'll come back to in details in a future post.

WINDOWS CALIBERS:

Both Rybka and The King seemed to have some flaws in the calibration task:
Rybka uses hypertrading in MP mode. HT divides each physical core to two logical threads and virtually doubles the total number of threads. Unfortunately, the increase in nodes per seconds doesn't deliver the expected strength increase. HT is not efficient when used with chess engines. I've chosen to tolerate the efficiency loss in Rybka case and keep following because on my notebook there's no option to disable HT via BIOS.
The second caliber is The King. It works well under Arena as a Winboard engine via KingUCI.exe which acts as wb2uci interface. Threads and hash are selectable via wb2uci.eng but strangely the engine hogs the CPU for no reason unless i run it with only 1 thread ouf 4 available. When i use all 4 threads, 3 of them stay loaded after King makes its move. I made sure it's not because of pondering because Fritzmark running in parallel hits the usual score. There must be something wrong keeping the "freed" threads busy. Since it's not comfortable to hear the cooling all the time, relying on 1 CPU rating of CCRL looks better. However, i suspect 1 thread out of 4 on my notebook is not exactly the same as 1 core out 2. It should be something between 0.5 to 1 CPU.

Finally, i've decided to add 50 ELO to all Android engines. Rybka and The King are both ranked well within acceptable error margins for the moment.

In next steps, i'll need some single thread Windows engines to bypass the hyperthreading effect and compare better with other rankings.

SWEET MEMORIES:
If one wonders why Novag Secondo is in the list as one the weakest dedicated chess computers ever sold, i must state it's a very old friend to me. It was my first chess computer in 1993 and still works without problem in 2015!!!

So i could not keep myself from putting it into the pit after all these years. After all, my retro companion needs more weak opponents to move forward a little bit.

BAYES RATINGS AFTER 12088 GAMES PLAYED BY 121 PROGRAMS
Rnk Name                     T O/S  Elo   +   - Gam Sco Oppo Dra
001 Komodo 9.2               4 A32 3287  45  42 236 82% 3037 28%
002 Stockfish 6              4 A32 3273  44  41 236 80% 3039 30%
003 Critter 1.6a             4 A32 3108  37  36 240 58% 3055 47%
004 Sting SF 4.8.4 JA        4 A32 3078  39  39 240 59% 3007 29%
005 Firenzina 2.4.1 xTreme   4 A32 3074  38  38 220 51% 3063 46%
006 BlackMamba 2.0           4 A32 3053  37  37 238 51% 3047 45%
007 Rybka 2.3.2a mp          4 W64 3009  90  91  40 45% 3051 35%
008 Texel 1.05               4 A32 3008  39  39 242 52% 2991 32%
009 DeepSaros ver.2.3f       1 A32 2995  38  38 246 55% 2957 32%
010 Senpai 1.0               4 A32 2956  40  39 236 54% 2931 28%
011 RobboLito 0.085e4l       4 A32 2937  40  40 230 50% 2938 30%
012 Cheng 4.39               4 A32 2922  39  39 234 50% 2928 32%
013 Hiarcs 13.71             2 IOS 2917 115 111  28 61% 2838 21%
014 Shredder 1.7.0           2 IOS 2883 109 108  26 54% 2863 46%
015 Gaviota v1.0-d           4 A32 2858  37  37 256 49% 2872 29%
016 Hakkapeliitta 3.0        1 A32 2846  38  38 248 50% 2857 31%
017 Arasan 18.0              4 A32 2841  38  38 240 48% 2864 32%
018 Exchess_7.71.beta.JA_xb  4 A32 2838  39  39 228 49% 2861 34%
019 Grapefruit 1.0           4 A32 2816  36  36 250 49% 2822 41%
020 Cyclone 3.4              4 A32 2789  37  37 240 49% 2799 37%
021 DiscoCheck 5.2.1         1 A32 2781  38  38 246 48% 2796 33%
022 Deep Saros 0.9           4 A32 2759  37  37 244 48% 2769 33%
023 Toga II 3.0              1 A32 2752  38  38 232 47% 2776 33%
024 Deuterium v14.3.34.130   1 A32 2733  37  37 238 55% 2695 37%
025 Bobcat 6.4b              4 A32 2723  38  38 246 49% 2734 23%
026 GNU Chess 5.60-32        1 A32 2714  39  39 230 54% 2686 28%
027 Doch32 1.3.4 JA          1 A32 2710  38  38 236 46% 2741 32%
028 Chess Pro 2016.02        2 IOS 2705 112 114  22 45% 2733 55%
029 Fruit reloaded 2.1       1 A32 2703  38  38 220 52% 2695 39%
030 Scorpio_2.7.7.JA_xb      1 A32 2688  42  42 198 51% 2690 31%
031 Murka 3 ARM UCI          1 A32 2687  35  35 258 50% 2689 36%
032 Strelka 5                1 A32 2658  38  38 230 54% 2629 30%
033 The King 3.50 x64        1 W64 2653  48  49 144 41% 2717 31%
034 IvanHoe 9.46b            4 A32 2652  39  39 232 44% 2700 28%
035 Crafty_24.1.JA_xb        1 A32 2623  38  38 244 51% 2614 25%
036 TheMadPrune 1.7.04       4 A32 2620  41  41 204 46% 2649 29%
037 Rodent 1.7 build 1       1 A32 2603  38  38 234 48% 2617 31%
038 Tucano_5.00.JA_xb        1 A32 2595  42  42 190 47% 2616 36%
039 CNVCS 1.2.0              2 IOS 2584  94  95  36 46% 2607 36%
040 RedQueen 1.1.97          4 A32 2561  39  40 232 46% 2590 22%
041 Bison 15.1               1 A32 2561  38  38 236 52% 2547 30%
042 Rhetoric 1.4.1           1 A32 2534  38  38 236 50% 2538 30%
043 Alfil 12.10              1 A32 2533  38  38 232 49% 2539 29%
044 Gull 1.2 arm JA          1 A32 2520  38  38 240 53% 2491 30%
045 Chess Genius 4.0.00      2 IOS 2507 180 198  10 30% 2677 20%
046 Cheese 1.7               1 A32 2489  38  38 242 44% 2531 31%
047 Daydreamer 1.75 JA       1 A32 2477  37  37 238 48% 2486 33%
048 GarboChess 3             1 A32 2472  39  39 236 51% 2464 25%
049 Rotor 0.8                1 A32 2471  38  39 236 46% 2506 28%
050 Fridolin 2.00            4 A32 2461  37  37 238 52% 2442 30%
051 Glaurung Mainz           1 A32 2457  45  45 168 46% 2486 29%
052 Chess Genius 2.6.4       1 A32 2455 224 239   4 38% 2505 75%
053 Danasah_5.07.JA_xb       1 A32 2442  40  39 222 53% 2418 26%
054 BBChess 1.3b JA          4 A32 2417  38  38 238 51% 2406 26%
055 Dirty_030411.JA_xb       1 A32 2405  40  40 222 54% 2376 27%
056 Sloppy_0.23.JA_xb        1 A32 2401  38  38 224 51% 2394 33%
057 Phalanx_XXIV.JA_xb       1 A32 2374  40  40 230 47% 2401 17%
058 GreKo_12.5.JA_xb         1 A32 2367  40  40 222 55% 2328 25%
059 Pepito v1.59             1 A32 2364  37  37 238 50% 2363 33%
060 Pawny_1.0.JA_uci2xb      1 A32 2349  40  39 228 55% 2317 25%
061 BetsabeII_1.47.JA_xb     1 A32 2339  41  41 224 52% 2324 20%
062 Maverick 1.0 JA          1 A32 2314  39  39 244 47% 2336 22%
063 Chess Wise 3.1.7         2 IOS 2298 311 508   2  0% 2507  0%
064 Ifrit_m1.8.JA_uci2xb     1 A32 2297  39  39 224 54% 2262 29%
065 Typhoon_1.0.r358.JA_xb   1 A32 2273  39  39 236 56% 2222 25%
066 Diablo 0.5.1b JA         1 A32 2263  39  39 236 47% 2285 24%
067 Amy_0.8.JA_xb            1 A32 2245  38  39 244 48% 2259 25%
068 Zurichess Fribourg       1 A32 2239  59  60 104 45% 2287 23%
069 Olithink_5.3.2.JA_xb     1 A32 2238  40  40 228 52% 2220 21%
070 Myrddin_0.86.JA_xb       1 A32 2226  42  42 228 51% 2206 21%
071 TJchess 1.1U             1 A32 2203  38  38 250 49% 2204 24%
072 MangoPaola_1.1.JA_xb     1 A32 2188  40  40 234 51% 2177 22%
073 Sungorus 1.4 JA          1 A32 2180  39  39 234 47% 2198 22%
074 Natwarlal_0.14.JA_xb     1 A32 2178  40  40 230 51% 2164 23%
075 KmtChess_1.21.JA_xb      1 A32 2111  41  41 234 49% 2124 20%
076 Bitfoot 1.0.norev        1 A32 2108  39  39 246 51% 2098 25%
077 Scidlet_2.61b2.JA_xb     1 A32 2099  41  41 234 52% 2076 13%
078 NGplay_9.86.JA_xb        1 A32 2086  40  40 230 51% 2079 24%
079 Rattate_Nosferatu.JA_xb  1 A32 2084  41  41 234 49% 2095 18%
080 Resp_0.19.JA_xb          1 A32 2077  40  40 240 52% 2061 19%
081 DanChess_1.04.JA_xb      1 A32 1999  41  41 226 49% 2009 18%
082 Kurt 0.9.2.2 JA          1 A32 1967  40  40 236 51% 1958 21%
083 Robocide 281214.JA       1 A32 1930  41  41 234 47% 1953 17%
084 AdroitChess0.4 JA        1 A32 1910  42  42 226 51% 1897 17%
085 Witz_Alpha21.JA_xb       1 A32 1906  41  41 222 46% 1941 20%
086 Knightcap_3.7F.JA_xb     1 A32 1895  43  42 216 55% 1859 15%
087 BikJump v1.8             1 A32 1895  42  42 224 48% 1908 19%
088 Clubfoot_r2293.JA        1 A32 1893  42  42 220 50% 1898 18%
089 Woodpecker_2.11.JA_xb    1 A32 1886  43  43 218 49% 1892 13%
090 Sjeng_1.12.JA_xb         1 A32 1853  42  42 218 50% 1854 18%
091 Leonidas_r83.JA_xb       1 A32 1852  42  42 216 47% 1877 17%
092 ZCT-0.3.2500             1 A32 1837  41  41 232 45% 1876 15%
093 Faile_1.44.JA_xb         1 A32 1821  41  41 206 49% 1830 30%
094 Cilian_4.14.JA_xb        1 A32 1813  39  39 230 50% 1810 27%
095 Samchess_JA_xb           1 A32 1808  43  43 210 47% 1833 16%
096 Ecce rev. 508            1 A32 1768  42  42 224 49% 1782 17%
097 Colchess_8.0.JA_xb       1 A32 1740  44  44 190 50% 1741 24%
098 Surprise_4.3.b13.JA_xb   1 A32 1738  58  58 122 54% 1706 12%
099 Claudia v. 0.5           1 A32 1731  61  60 118 56% 1681 17%
100 Smash 1.03.JA            1 A32 1730  43  43 230 52% 1694 13%
101 Zzzzzz_3.5.1.JA_xb       1 A32 1646  45  45 178 54% 1589 29%
102 Gunborg_1.0.JA_uci2xb    1 A32 1621  42  42 228 54% 1556 21%
103 Hoichess_0.12.1.JA_xb    1 A32 1621  42  43 218 52% 1581 20%
104 Colossus 4.0 100X        1 C64 1616 236 208  10 80% 1243 20%
105 Rocinante 2.0 JA         1 A32 1608  44  44 218 55% 1522 17%
106 Kitteneitor_060513.JA_xb 1 A32 1606  45  45 176 49% 1576 36%
107 Jester_0.84.JA_xb        1 A32 1604  50  50 168 53% 1538 11%
108 Tscp_1.8.1.AB_xb         1 A32 1594  47  48 176 48% 1587 17%
109 Chenard_2014.07.11.JA_xb 1 A32 1594  47  48 190 42% 1651 12%
110 Pulse 1.5-cpp            1 A32 1579  43  43 222 55% 1481 27%
111 VIRUTOR CHESS 1.1.1      1 A32 1415  48  48 220 52% 1353 10%
112 Superpawn b108           1 A32 1371  55  56 152 49% 1388 16%
113 Chess for Android        1 A32 1371  47  48 227 47% 1359 15%
114 K2 v.075                 1 A32 1363  61  61 146 51% 1341  8%
115 Chess Titans             1 W64 1281 211 202   7 57% 1252 29%
116 Trappy_Beowulf_2.0.JA_xb 1 A32 1163  51  53 216 39% 1248 10%
117 Colossus 4.0             1 C64 1118 169 186  14 36% 1203 14%
118 Byak 8.10.14.JA          1 A32 1060  57  60 159 24% 1317 16%
119 Xadreco_5.7.JA_xb        1 A32  972  64  70 154 16% 1334  8%
120 Novag Secondo            1 TTC  821 344 -39   5 40%  900  0%
121 OliveChess 0.2.7         1 A32  556 353-300 128  0% 1438  0%


Rapidroid test platform:
* GT-N7100 1.6 * 4 + 256MB hash: All Android progs,
* Codegen Novatab 1.4* 4 + 256MB: All Android progs,
* Polypad 1010IPS tablet 1.61 * 2 + 128MB: Single thread Android progs
* HTC Diam 528Mhz, 16MB hash: Windows Mobile,
* i7 M620 2.67 Ghz dual + Arena 3.5 + 2GB hash: Windows 64
* iPhone5S A7 1.3 Ghz * 2: iOS programs
* DosBox 1.74: DOS programs,
* WinVICE 2.24: Commodore-64 progs,
* Messtiny UCI adapters or CB-Emu2014: Mephisto programs,
* Openings: 20 ply from Adam Hair or 16 ply from TCEC, no Q exchange, +0.15 to +0.40 evaluated by Stockfish and Komodo at depth 20 minimum, played twice each color.
* Repeating openings and twin games not allowed between two programs
* Tablebases and pondering off
* Time control: 10 to 30 sec/move or 600+0 to 1800+5 or closest known by both programs.

6 comments:

  1. Where can I donwload the rapidroid engines like "the king" or others.
    thanks

    ReplyDelete
  2. Free Android engines: Check my repository at box.com. You may find the folder link here in this blog.
    Others: i don't store them. For the King for instance, google "the king 3.50 x64 uci"

    ReplyDelete
  3. hi u should try this android sf compile 071015 by:http://talkchess.com/forum/viewtopic.php?topic_view=threads&p=640622&t=57523&sid=cc721cf69b46d3dce46f64206eb2c797
    arm7 compile

    ReplyDelete
  4. I'm gonna take a look at that soon. Peter Ă–sterlund is the author of Droidfish and Texel. His arm7 compile should perform well.

    ReplyDelete
  5. Hi, thanks for your good work!

    I wonder if you still have the Zurichess Basel complied. I have checked your box.com repository but Zurichess Basel is not there.

    Best regards

    ReplyDelete
    Replies
    1. Very good remark. I've posted Basel today in Chesstroid.

      Delete