HAL9000

HAL9000
"It just isn't conceivable that you can design a program strong enough to beat players like me."

March 27, 2014

Chesstroid ratings introduced

Finally releasing the first list covering 89 UCI/XB engines compatible with tournament mode of Chess for Android. I think it's the first serious attempt after Aart Bik's 2013 Tournament which without any doubt, was a remarkable effort.

The results below represent only 8% of the expected accuracy as there remain 46 opening positions to go. But i'm already satisfied with the values obtained so far. Frankly, i was expecting worse than this in the beginning.

There's no proof for calibration yet. I've just made sure Stockfish DD is reasonably behind its 3200 elo big brother running on a recent PC configuration (800 kN vs 12000 kN assumed to reflect -250 elo gap). Other engines are also checked for reasonable gap with their PC versions. And finally, low end engines are the ones i can easily defeat all the time. So, they can't be more than 1000.

Test platform:
* Samsung Galaxy Note II running @ 1.6 Ghz (Cpu governor set to performance or at least interactive. No downscaling allowed!)
* 64MB hash where selectable
* 4 cpu threads where selectable
* Own books disabled and replaced by Silver Opening Suite positions (4 of 50 played so far)
* All opening positions played twice with different colors
* Tablebases off
* Ponder off
* Time control: 5 sec/move

## Name                       Elo    +    -  Gam  Sco  Opp.  Dra
01 Stockfish DD              2970   66   62   86  77%  2782  38%
02 Stockfish 4               2888   60   58   86  65%  2790  48%
03 Stockfish 3               2881   61   60   86  63%  2790  42%
04 Stockfish 2.3.1           2868   60   58   86  60%  2792  47%
05 Critter 1.4 32-bit        2831   59   58   86  56%  2795  49%
06 Critter 1.6a 32-bit       2826   59   58   86  55%  2796  45%
07 Stockfish 2.0             2809   60   60   86  51%  2797  41%
08 Critter 1.2 32-bit        2797   72   69   84  70%  2606  27%
09 RobboLito 0.085e4l        2753   60   62   82  40%  2808  46%
10 Komodo32 2.03 JA          2747   60   61   86  48%  2758  42%
11 BlackMamba 2.0 32bit      2717   83   76   82  82%  2410  20%
12 Senpai 1.0                2687   63   64   82  38%  2765  35%
13 RobboLito 0.085g3l x86    2674   64   64   86  49%  2664  34%
14 Komodo32 3 AB             2646   66   68   86  46%  2667  22%
15 Komodo32 1.3 JA           2597   67   67   84  49%  2592  27%
16 Gaviota v1.0              2571   70   68   80  59%  2490  24%
17 Texel 1.03 32-bit         2565   70   71   84  46%  2583  18%
18 Toga II 3.0               2508   68   70   84  41%  2588  25%
19 Arasan 15.2 JA            2458   66   65   84  54%  2426  27%
20 IvanHoe 9.46b             2416   67   67   84  49%  2430  21%
21 Toga II 1.4.1SE           2383   65   65   84  45%  2433  27%
22 Arasan 14.0.1             2324   65   66   84  44%  2371  26%
23 Toga II 2.0 JA            2318   65   64   82  54%  2298  30%
24 Arasan 13.4               2315   67   65   80  62%  2237  29%
25 RedQueen 1.1.3 (TCEC) JA  2293   70   72   80  41%  2381  21%
26 DiscoCheck 3.7.1          2279   65   65   82  48%  2302  24%
27 Texel 1.01 32-bit         2264   66   67   84  41%  2347  25%
28 Gaviota v0.86             2261   66   64   80  58%  2211  29%
29 DiscoCheck 4.0.1          2256   64   64   82  49%  2273  32%
30 Crafty_23.5.JA_xb         2253   71   73   82  35%  2390  18%
31 Crafty_23.4.JA_xb         2204   65   66   80  42%  2271  29%
32 RedQueen 1.1.2            2192   67   69   82  38%  2296  21%
33 Rodent 1.00               2171   61   61   82  51%  2159  41%
34 Alfil 12.10 w32           2157   66   65   80  53%  2147  25%
35 gaviota v0.84             2151   65   63   80  63%  2061  35%
36 Rodent 0.18.0             2149   65   63   84  63%  2052  32%
37 GNU Chess 5.50-32         2145   63   64   80  40%  2223  35%
38 Rotor 0.8                 2098   65   66   80  43%  2152  29%
39 Rotor 0.7a                2088   63   63   82  49%  2094  28%
40 cheng3 1.07 JA            2086   66   66   82  50%  2087  24%
41 Daydreamer 1.75 JA        2078   65   66   82  48%  2095  22%
42 gaviota v0.83             2059   66   66   82  46%  2090  22%
43 Scorpio_2.7.JA_xb         2035   64   65   82  42%  2092  30%
44 GarboChess 3 (32-bit)     2022   67   64   84  66%  1906  25%
45 Pepito v1.59              2005   62   63   84  45%  2038  30%
46 Sloppy_0.23.JA_xb         2001   62   63   84  44%  2038  33%
47 Tucano_1.04.AB_xb         1968   64   64   84  51%  1963  24%
48 GNU Chess 6.0.2           1942   62   63   84  46%  1966  31%
49 DoubleCheck 2.7           1930   68   68   84  52%  1915  13%
50 DoubleCheck 2.6 JA        1912   65   64   84  52%  1898  23%
51 Danasah_4.88.JA_xb        1903   65   65   84  48%  1918  23%
52 DanasahZ_0.4.JA_xb        1901   65   65   80  48%  1914  29%
53 BetsabeII_1.30.JA_xb      1880   66   66   84  54%  1849  17%
54 Danasah_4.66.JA_xb        1851   70   68   80  60%  1766  23%
55 Typhoon_1.0.r358.JA_xb    1842   65   65   84  48%  1853  20%
56 Danasah_5.06.JA_xb        1838   69   67   80  66%  1713  26%
57 Greko_8.2_uci             1831   63   62   80  58%  1782  38%
58 GreKo_9.8.AB_uci          1818   64   65   84  42%  1880  27%
59 Phalanx_XXIII.JA_xb       1816   67   69   84  42%  1880  14%
60 GreKo_9.0.JA_uci          1795   63   63   84  50%  1790  29%
61 Diablo 0.5.1b JA          1773   63   63   84  47%  1792  27%
62 GreKo_10.0.JA_xb          1771   63   63   84  50%  1767  29%
63 Olithink_5.3.2.JA_xb      1750   67   67   84  53%  1725  15%
64 BetsabeII_1.22.JA_xb      1730   75   71   80  69%  1567  13%
65 Sungorus 1.4 JA           1690   68   68   84  55%  1646  21%
66 Myrddin_0.86.JA_xb        1686   70   68   84  62%  1584  14%
67 Jazz 6.40 JA  (unknown)   1683   65   67   84  41%  1738  25%
68 TJchess 1.1U              1670   65   65   84  52%  1645  26%
69 Natwarlal_0.14.JA_xb      1659   68   70   84  42%  1715  13%
70 Scidlet_2.61b2.JA_xb      1649   69   68   84  57%  1588  15%
71 DoubleCheck 2.3           1627   68   69   84  46%  1652  15%
72 KmtChess_1.21.JA_xb       1623   67   69   84  38%  1719  17%
73 Jazz v444 JA (unknown)    1552   69   69   84  52%  1534  15%
74 Jazz v5.01 JA (unknown)   1519   66   67   84  48%  1537  29%
75 Sjeng_1.12.JA_xb          1409   78   77   82  59%  1304  11%
76 BikJump v1.8 (32-bit)     1398   77   75   82  59%  1305  12%
77 ZCT-0.3.2500              1339   75   77   82  40%  1416  12%
78 AdroitChess 0.3           1333   75   78   82  40%  1417  15%
79 AdroitChess0.4 JA         1325   74   77   82  40%  1418  11%
80 Leonidas_r83.JA_xb        1315   74   72   80  65%  1166  23%
81 BikJump v2.1P (32-bit)    1291   75   79   82  35%  1424  13%
82 Sjaak_4.68.JA_xb          1279   81   77   78  69%  1089   8%
83 Tscp_1.8.1.AB_xb          1171   75   74   78  56%  1100  13%
84 Zzzzzz_3.5.1.JA_xb        1131   72   72   78  51%  1104  21%
85 Rocinante 2.0 JA          1097   74   75   78  49%  1108  13%
86 VIRUTOR CHESS 1.1.1       1004   76   80   78  36%  1117  13%
87 VIRUTOR CHESS 1.1.4        991   76   80   78  35%  1119  15%
88 Chess for Android          859   84   93   78  21%  1132   6%
89 Simplex 0.9.8              655  115   40   78   6%  1153   3%

1 comment:

thulannguyen said...

Thanks for sharing, nice post! Post really provice useful information!

An Thái Sơn với website anthaison.vn chuyên sản phẩm máy đưa võng hay máy đưa võng tự động tốt cho bé là địa chỉ bán máy đưa võng giá rẻ tại TP.HCM và giúp bạn tìm máy đưa võng loại nào tốt nhất hiện nay.