HAL9000

HAL9000
"It just isn't conceivable that you can design a program strong enough to beat players like me."

March 27, 2014

Chesstroid ratings introduced

Finally releasing the first list covering 89 UCI/XB engines compatible with tournament mode of Chess for Android. I think it's the first serious attempt after Aart Bik's 2013 Tournament which without any doubt, was a remarkable effort.

The results below represent only 8% of the expected accuracy as there remain 46 opening positions to go. But i'm already satisfied with the values obtained so far. Frankly, i was expecting worse than this in the beginning.

There's no proof for calibration yet. I've just made sure Stockfish DD is reasonably behind its 3200 elo big brother running on a recent PC configuration (800 kN vs 12000 kN assumed to reflect -250 elo gap). Other engines are also checked for reasonable gap with their PC versions. And finally, low end engines are the ones i can easily defeat all the time. So, they can't be more than 1000.

Test platform:
* Samsung Galaxy Note II running @ 1.6 Ghz (Cpu governor set to performance or at least interactive. No downscaling allowed!)
* 64MB hash where selectable
* 4 cpu threads where selectable
* Own books disabled and replaced by Silver Opening Suite positions (4 of 50 played so far)
* All opening positions played twice with different colors
* Tablebases off
* Ponder off
* Time control: 5 sec/move

## Name                       Elo    +    -  Gam  Sco  Opp.  Dra
01 Stockfish DD              2970   66   62   86  77%  2782  38%
02 Stockfish 4               2888   60   58   86  65%  2790  48%
03 Stockfish 3               2881   61   60   86  63%  2790  42%
04 Stockfish 2.3.1           2868   60   58   86  60%  2792  47%
05 Critter 1.4 32-bit        2831   59   58   86  56%  2795  49%
06 Critter 1.6a 32-bit       2826   59   58   86  55%  2796  45%
07 Stockfish 2.0             2809   60   60   86  51%  2797  41%
08 Critter 1.2 32-bit        2797   72   69   84  70%  2606  27%
09 RobboLito 0.085e4l        2753   60   62   82  40%  2808  46%
10 Komodo32 2.03 JA          2747   60   61   86  48%  2758  42%
11 BlackMamba 2.0 32bit      2717   83   76   82  82%  2410  20%
12 Senpai 1.0                2687   63   64   82  38%  2765  35%
13 RobboLito 0.085g3l x86    2674   64   64   86  49%  2664  34%
14 Komodo32 3 AB             2646   66   68   86  46%  2667  22%
15 Komodo32 1.3 JA           2597   67   67   84  49%  2592  27%
16 Gaviota v1.0              2571   70   68   80  59%  2490  24%
17 Texel 1.03 32-bit         2565   70   71   84  46%  2583  18%
18 Toga II 3.0               2508   68   70   84  41%  2588  25%
19 Arasan 15.2 JA            2458   66   65   84  54%  2426  27%
20 IvanHoe 9.46b             2416   67   67   84  49%  2430  21%
21 Toga II 1.4.1SE           2383   65   65   84  45%  2433  27%
22 Arasan 14.0.1             2324   65   66   84  44%  2371  26%
23 Toga II 2.0 JA            2318   65   64   82  54%  2298  30%
24 Arasan 13.4               2315   67   65   80  62%  2237  29%
25 RedQueen 1.1.3 (TCEC) JA  2293   70   72   80  41%  2381  21%
26 DiscoCheck 3.7.1          2279   65   65   82  48%  2302  24%
27 Texel 1.01 32-bit         2264   66   67   84  41%  2347  25%
28 Gaviota v0.86             2261   66   64   80  58%  2211  29%
29 DiscoCheck 4.0.1          2256   64   64   82  49%  2273  32%
30 Crafty_23.5.JA_xb         2253   71   73   82  35%  2390  18%
31 Crafty_23.4.JA_xb         2204   65   66   80  42%  2271  29%
32 RedQueen 1.1.2            2192   67   69   82  38%  2296  21%
33 Rodent 1.00               2171   61   61   82  51%  2159  41%
34 Alfil 12.10 w32           2157   66   65   80  53%  2147  25%
35 gaviota v0.84             2151   65   63   80  63%  2061  35%
36 Rodent 0.18.0             2149   65   63   84  63%  2052  32%
37 GNU Chess 5.50-32         2145   63   64   80  40%  2223  35%
38 Rotor 0.8                 2098   65   66   80  43%  2152  29%
39 Rotor 0.7a                2088   63   63   82  49%  2094  28%
40 cheng3 1.07 JA            2086   66   66   82  50%  2087  24%
41 Daydreamer 1.75 JA        2078   65   66   82  48%  2095  22%
42 gaviota v0.83             2059   66   66   82  46%  2090  22%
43 Scorpio_2.7.JA_xb         2035   64   65   82  42%  2092  30%
44 GarboChess 3 (32-bit)     2022   67   64   84  66%  1906  25%
45 Pepito v1.59              2005   62   63   84  45%  2038  30%
46 Sloppy_0.23.JA_xb         2001   62   63   84  44%  2038  33%
47 Tucano_1.04.AB_xb         1968   64   64   84  51%  1963  24%
48 GNU Chess 6.0.2           1942   62   63   84  46%  1966  31%
49 DoubleCheck 2.7           1930   68   68   84  52%  1915  13%
50 DoubleCheck 2.6 JA        1912   65   64   84  52%  1898  23%
51 Danasah_4.88.JA_xb        1903   65   65   84  48%  1918  23%
52 DanasahZ_0.4.JA_xb        1901   65   65   80  48%  1914  29%
53 BetsabeII_1.30.JA_xb      1880   66   66   84  54%  1849  17%
54 Danasah_4.66.JA_xb        1851   70   68   80  60%  1766  23%
55 Typhoon_1.0.r358.JA_xb    1842   65   65   84  48%  1853  20%
56 Danasah_5.06.JA_xb        1838   69   67   80  66%  1713  26%
57 Greko_8.2_uci             1831   63   62   80  58%  1782  38%
58 GreKo_9.8.AB_uci          1818   64   65   84  42%  1880  27%
59 Phalanx_XXIII.JA_xb       1816   67   69   84  42%  1880  14%
60 GreKo_9.0.JA_uci          1795   63   63   84  50%  1790  29%
61 Diablo 0.5.1b JA          1773   63   63   84  47%  1792  27%
62 GreKo_10.0.JA_xb          1771   63   63   84  50%  1767  29%
63 Olithink_5.3.2.JA_xb      1750   67   67   84  53%  1725  15%
64 BetsabeII_1.22.JA_xb      1730   75   71   80  69%  1567  13%
65 Sungorus 1.4 JA           1690   68   68   84  55%  1646  21%
66 Myrddin_0.86.JA_xb        1686   70   68   84  62%  1584  14%
67 Jazz 6.40 JA  (unknown)   1683   65   67   84  41%  1738  25%
68 TJchess 1.1U              1670   65   65   84  52%  1645  26%
69 Natwarlal_0.14.JA_xb      1659   68   70   84  42%  1715  13%
70 Scidlet_2.61b2.JA_xb      1649   69   68   84  57%  1588  15%
71 DoubleCheck 2.3           1627   68   69   84  46%  1652  15%
72 KmtChess_1.21.JA_xb       1623   67   69   84  38%  1719  17%
73 Jazz v444 JA (unknown)    1552   69   69   84  52%  1534  15%
74 Jazz v5.01 JA (unknown)   1519   66   67   84  48%  1537  29%
75 Sjeng_1.12.JA_xb          1409   78   77   82  59%  1304  11%
76 BikJump v1.8 (32-bit)     1398   77   75   82  59%  1305  12%
77 ZCT-0.3.2500              1339   75   77   82  40%  1416  12%
78 AdroitChess 0.3           1333   75   78   82  40%  1417  15%
79 AdroitChess0.4 JA         1325   74   77   82  40%  1418  11%
80 Leonidas_r83.JA_xb        1315   74   72   80  65%  1166  23%
81 BikJump v2.1P (32-bit)    1291   75   79   82  35%  1424  13%
82 Sjaak_4.68.JA_xb          1279   81   77   78  69%  1089   8%
83 Tscp_1.8.1.AB_xb          1171   75   74   78  56%  1100  13%
84 Zzzzzz_3.5.1.JA_xb        1131   72   72   78  51%  1104  21%
85 Rocinante 2.0 JA          1097   74   75   78  49%  1108  13%
86 VIRUTOR CHESS 1.1.1       1004   76   80   78  36%  1117  13%
87 VIRUTOR CHESS 1.1.4        991   76   80   78  35%  1119  15%
88 Chess for Android          859   84   93   78  21%  1132   6%
89 Simplex 0.9.8              655  115   40   78   6%  1153   3%

No comments: