The results below represent only 8% of the expected accuracy as there remain 46 opening positions to go. But i'm already satisfied with the values obtained so far. Frankly, i was expecting worse than this in the beginning.
There's no proof for calibration yet. I've just made sure Stockfish DD is reasonably behind its 3200 elo big brother running on a recent PC configuration (800 kN vs 12000 kN assumed to reflect -250 elo gap). Other engines are also checked for reasonable gap with their PC versions. And finally, low end engines are the ones i can easily defeat all the time. So, they can't be more than 1000.
Test platform:
* Samsung Galaxy Note II running @ 1.6 Ghz (Cpu governor set to performance or at least interactive. No downscaling allowed!)
* 64MB hash where selectable
* 4 cpu threads where selectable
* Own books disabled and replaced by Silver Opening Suite positions (4 of 50 played so far)
* All opening positions played twice with different colors
* Tablebases off
* Ponder off
* Time control: 5 sec/move
## Name Elo + - Gam Sco Opp. Dra
01 Stockfish DD 2970 66 62 86 77% 2782 38%
02 Stockfish 4 2888 60 58 86 65% 2790 48%
03 Stockfish 3 2881 61 60 86 63% 2790 42%
04 Stockfish 2.3.1 2868 60 58 86 60% 2792 47%
05 Critter 1.4 32-bit 2831 59 58 86 56% 2795 49%
06 Critter 1.6a 32-bit 2826 59 58 86 55% 2796 45%
07 Stockfish 2.0 2809 60 60 86 51% 2797 41%
08 Critter 1.2 32-bit 2797 72 69 84 70% 2606 27%
09 RobboLito 0.085e4l 2753 60 62 82 40% 2808 46%
10 Komodo32 2.03 JA 2747 60 61 86 48% 2758 42%
11 BlackMamba 2.0 32bit 2717 83 76 82 82% 2410 20%
12 Senpai 1.0 2687 63 64 82 38% 2765 35%
13 RobboLito 0.085g3l x86 2674 64 64 86 49% 2664 34%
14 Komodo32 3 AB 2646 66 68 86 46% 2667 22%
15 Komodo32 1.3 JA 2597 67 67 84 49% 2592 27%
16 Gaviota v1.0 2571 70 68 80 59% 2490 24%
17 Texel 1.03 32-bit 2565 70 71 84 46% 2583 18%
18 Toga II 3.0 2508 68 70 84 41% 2588 25%
19 Arasan 15.2 JA 2458 66 65 84 54% 2426 27%
20 IvanHoe 9.46b 2416 67 67 84 49% 2430 21%
21 Toga II 1.4.1SE 2383 65 65 84 45% 2433 27%
22 Arasan 14.0.1 2324 65 66 84 44% 2371 26%
23 Toga II 2.0 JA 2318 65 64 82 54% 2298 30%
24 Arasan 13.4 2315 67 65 80 62% 2237 29%
25 RedQueen 1.1.3 (TCEC) JA 2293 70 72 80 41% 2381 21%
26 DiscoCheck 3.7.1 2279 65 65 82 48% 2302 24%
27 Texel 1.01 32-bit 2264 66 67 84 41% 2347 25%
28 Gaviota v0.86 2261 66 64 80 58% 2211 29%
29 DiscoCheck 4.0.1 2256 64 64 82 49% 2273 32%
30 Crafty_23.5.JA_xb 2253 71 73 82 35% 2390 18%
31 Crafty_23.4.JA_xb 2204 65 66 80 42% 2271 29%
32 RedQueen 1.1.2 2192 67 69 82 38% 2296 21%
33 Rodent 1.00 2171 61 61 82 51% 2159 41%
34 Alfil 12.10 w32 2157 66 65 80 53% 2147 25%
35 gaviota v0.84 2151 65 63 80 63% 2061 35%
36 Rodent 0.18.0 2149 65 63 84 63% 2052 32%
37 GNU Chess 5.50-32 2145 63 64 80 40% 2223 35%
38 Rotor 0.8 2098 65 66 80 43% 2152 29%
39 Rotor 0.7a 2088 63 63 82 49% 2094 28%
40 cheng3 1.07 JA 2086 66 66 82 50% 2087 24%
41 Daydreamer 1.75 JA 2078 65 66 82 48% 2095 22%
42 gaviota v0.83 2059 66 66 82 46% 2090 22%
43 Scorpio_2.7.JA_xb 2035 64 65 82 42% 2092 30%
44 GarboChess 3 (32-bit) 2022 67 64 84 66% 1906 25%
45 Pepito v1.59 2005 62 63 84 45% 2038 30%
46 Sloppy_0.23.JA_xb 2001 62 63 84 44% 2038 33%
47 Tucano_1.04.AB_xb 1968 64 64 84 51% 1963 24%
48 GNU Chess 6.0.2 1942 62 63 84 46% 1966 31%
49 DoubleCheck 2.7 1930 68 68 84 52% 1915 13%
50 DoubleCheck 2.6 JA 1912 65 64 84 52% 1898 23%
51 Danasah_4.88.JA_xb 1903 65 65 84 48% 1918 23%
52 DanasahZ_0.4.JA_xb 1901 65 65 80 48% 1914 29%
53 BetsabeII_1.30.JA_xb 1880 66 66 84 54% 1849 17%
54 Danasah_4.66.JA_xb 1851 70 68 80 60% 1766 23%
55 Typhoon_1.0.r358.JA_xb 1842 65 65 84 48% 1853 20%
56 Danasah_5.06.JA_xb 1838 69 67 80 66% 1713 26%
57 Greko_8.2_uci 1831 63 62 80 58% 1782 38%
58 GreKo_9.8.AB_uci 1818 64 65 84 42% 1880 27%
59 Phalanx_XXIII.JA_xb 1816 67 69 84 42% 1880 14%
60 GreKo_9.0.JA_uci 1795 63 63 84 50% 1790 29%
61 Diablo 0.5.1b JA 1773 63 63 84 47% 1792 27%
62 GreKo_10.0.JA_xb 1771 63 63 84 50% 1767 29%
63 Olithink_5.3.2.JA_xb 1750 67 67 84 53% 1725 15%
64 BetsabeII_1.22.JA_xb 1730 75 71 80 69% 1567 13%
65 Sungorus 1.4 JA 1690 68 68 84 55% 1646 21%
66 Myrddin_0.86.JA_xb 1686 70 68 84 62% 1584 14%
67 Jazz 6.40 JA (unknown) 1683 65 67 84 41% 1738 25%
68 TJchess 1.1U 1670 65 65 84 52% 1645 26%
69 Natwarlal_0.14.JA_xb 1659 68 70 84 42% 1715 13%
70 Scidlet_2.61b2.JA_xb 1649 69 68 84 57% 1588 15%
71 DoubleCheck 2.3 1627 68 69 84 46% 1652 15%
72 KmtChess_1.21.JA_xb 1623 67 69 84 38% 1719 17%
73 Jazz v444 JA (unknown) 1552 69 69 84 52% 1534 15%
74 Jazz v5.01 JA (unknown) 1519 66 67 84 48% 1537 29%
75 Sjeng_1.12.JA_xb 1409 78 77 82 59% 1304 11%
76 BikJump v1.8 (32-bit) 1398 77 75 82 59% 1305 12%
77 ZCT-0.3.2500 1339 75 77 82 40% 1416 12%
78 AdroitChess 0.3 1333 75 78 82 40% 1417 15%
79 AdroitChess0.4 JA 1325 74 77 82 40% 1418 11%
80 Leonidas_r83.JA_xb 1315 74 72 80 65% 1166 23%
81 BikJump v2.1P (32-bit) 1291 75 79 82 35% 1424 13%
82 Sjaak_4.68.JA_xb 1279 81 77 78 69% 1089 8%
83 Tscp_1.8.1.AB_xb 1171 75 74 78 56% 1100 13%
84 Zzzzzz_3.5.1.JA_xb 1131 72 72 78 51% 1104 21%
85 Rocinante 2.0 JA 1097 74 75 78 49% 1108 13%
86 VIRUTOR CHESS 1.1.1 1004 76 80 78 36% 1117 13%
87 VIRUTOR CHESS 1.1.4 991 76 80 78 35% 1119 15%
88 Chess for Android 859 84 93 78 21% 1132 6%
89 Simplex 0.9.8 655 115 40 78 6% 1153 3%
No comments:
Post a Comment