Last week, Rhetoric had performed 2176 ELO using bullet time control of 1 sec/move and the result was shared in a previous post. At 5 sec/move, the rating jumped to 2255. Well, +79 is something not negligeable but i assume it's within scientific tolerances bearing in mind:
* Rhetoric benefits from more time better than other engines, no direct proof, just one of the possibilities.
* Bullet test was practiced against 10 opponents only. In blitzoid, it had 31 various opponents. Then, variety matters.
* Bullet test was played from 10 selected Silver suite positions. Blitzoid used first 14 of 50, following the standard of the project. Therefore, openings may influence as well.
Experience tells it's useless to try to meet the exact expectation in every result. Instead it's better to increase variety and number of samples. This means i'm done with 3 new engines added in june and the rounds must continue now.
It's a long way to the end of the Silver suite with a lot of engines...
BLITZOID RANKING / 26-JUN-2014
11432 GAMES PLAYED BY 92 PROGRAMS
COMPUTED WITH BAYESELO, OFFSET: 2117
Ra Name Elo + - Gam Sco Oppo Dra
1 Stockfish 5 3010 41 39 250 78% 2797 31%
2 Stockfish DD 2976 38 37 250 75% 2797 38%
3 Stockfish 3 2896 35 34 278 59% 2827 37%
4 Stockfish 4 2895 34 33 278 60% 2827 46%
5 Stockfish 2.3.1 2868 34 33 276 56% 2817 45%
6 Critter 1.4 2856 34 34 276 55% 2819 41%
7 Critter 1.6a 2854 34 34 276 55% 2817 42%
8 BlackMamba 2.0 2787 39 39 262 66% 2635 32%
9 Critter 1.2 2782 37 37 272 57% 2714 33%
10 Stockfish 2.0 2778 36 36 274 51% 2764 31%
11 RobboLito 0.085e4l 2720 36 37 264 44% 2754 35%
12 Komodo32 2.03 JA 2698 37 37 270 45% 2732 30%
13 RobboLito 0.085g3l 2680 37 37 262 54% 2641 32%
14 Senpai 1.0 2667 37 37 266 42% 2722 30%
15 Komodo32 3 AB 2663 38 38 262 47% 2676 27%
16 Texel 1.04 32-bit 2611 41 40 248 54% 2574 21%
17 Gaviota v1.0 2578 37 37 262 56% 2529 30%
18 Komodo32 1.3 JA 2575 38 39 262 44% 2622 27%
19 Texel 1.03 2561 40 41 248 48% 2574 22%
20 Toga II 3.0 2498 38 38 264 50% 2506 24%
21 IvanHoe 9.46b 2497 39 39 256 55% 2457 23%
22 Arasan 15.2 JA 2422 39 39 256 51% 2419 20%
23 Gaviota v0.86 2406 39 39 252 48% 2432 23%
24 Toga II 1.4.1SE 2387 38 38 260 42% 2455 25%
25 Toga II 2.0 JA 2376 38 38 256 49% 2394 26%
26 DiscoCheck 3.7.1 2366 38 38 256 47% 2392 24%
27 Texel 1.01 32-bit 2354 38 38 264 44% 2407 24%
28 Arasan 13.4 2330 37 37 254 49% 2343 26%
29 DiscoCheck 4.0.1 2294 37 37 258 47% 2319 27%
30 Arasan 14.0.1 2292 37 37 260 44% 2337 27%
31 Crafty_23.4.JA_xb 2284 37 37 256 51% 2284 23%
32 GNU Chess 5.50-32 2281 37 37 256 47% 2307 29%
33 gaviota v0.84 2265 38 38 252 53% 2252 24%
34 Rhetoric 1.4 Android 2255 39 39 224 49% 2264 28%
35 Crafty_23.5.JA_xb 2249 38 39 256 45% 2301 20%
36 Alfil 12.10 w32 2244 38 38 250 51% 2237 24%
37 RedQueen 1.1.3 TCEC 2244 40 40 254 43% 2310 18%
38 Rodent 1.00 2242 37 37 248 53% 2219 31%
39 RedQueen 1.1.2 2241 38 38 258 45% 2288 21%
40 Rodent 0.18.0 2213 37 37 248 55% 2172 30%
41 Rotor 0.7a 2209 36 37 254 48% 2224 29%
42 cheng3 1.07 JA 2184 38 38 248 49% 2194 20%
43 Rotor 0.8 2172 38 38 246 48% 2187 24%
44 GarboChess 3 2170 38 38 250 56% 2126 23%
45 Daydreamer 1.75 JA 2163 37 37 252 49% 2170 28%
46 Scorpio_2.7.JA_xb 2160 38 38 248 50% 2159 23%
47 gaviota v0.83 2142 38 38 246 47% 2164 22%
48 Sloppy_0.23.JA_xb 2126 37 37 248 48% 2143 26%
49 Pepito v1.59 2089 39 39 244 49% 2097 21%
50 Danasah_4.88.JA_xb 2073 37 38 246 47% 2093 26%
51 GNU Chess 6.0.2 2066 37 37 244 48% 2074 29%
52 DanasahZ_0.4.JA_xb 2064 38 38 242 49% 2073 26%
53 Tucano_1.04.AB_xb 2060 39 39 244 50% 2059 19%
54 DoubleCheck 2.7 2057 39 39 244 51% 2047 16%
55 DoubleCheck 2.6 JA 2057 39 39 244 50% 2060 18%
56 Danasah_5.06.JA_xb 2027 39 38 240 55% 1981 27%
57 Danasah_4.66.JA_xb 2011 39 39 242 52% 1990 21%
58 Typhoon_1.0.r358.JA_xb 2005 39 39 244 51% 1995 19%
59 BetsabeII_1.30.JA_xb 2005 39 39 244 51% 1994 16%
60 Diablo 0.5.1b JA 1985 38 38 244 52% 1965 25%
61 Olithink_5.3.2.JA_xb 1979 40 40 244 56% 1935 16%
62 Greko_8.2_uci 1965 38 38 240 54% 1939 27%
63 GreKo_9.8.AB_uci 1961 38 38 244 49% 1963 24%
64 GreKo_9.0.JA_uci 1954 39 38 244 53% 1927 20%
65 GreKo_10.0.JA_xb 1940 38 38 244 51% 1931 23%
66 Phalanx_XXIII.JA_xb 1938 40 41 244 46% 1968 13%
67 Sungorus 1.4 JA 1892 40 41 244 49% 1897 16%
68 BetsabeII_1.22.JA_xb 1863 41 41 240 56% 1803 13%
69 TJchess 1.1U 1847 40 40 244 51% 1822 23%
70 Myrddin_0.86.JA_xb 1835 40 40 244 53% 1804 16%
71 Natwarlal_0.14.JA_xb 1812 41 41 244 51% 1795 12%
72 DoubleCheck 2.3 1811 41 41 244 50% 1799 15%
73 KmtChess_1.21.JA_xb 1809 40 40 244 49% 1810 19%
74 Jazz 6.40 JA 1785 40 41 244 46% 1808 20%
75 Scidlet_2.61b2.JA_xb 1753 41 41 244 49% 1753 16%
76 Jazz v444 JA 1740 40 41 244 49% 1743 21%
77 Jazz v5.01 JA 1719 41 41 244 53% 1696 20%
78 Sjeng_1.12.JA_xb 1599 43 43 242 52% 1573 11%
79 BikJump v1.8 1570 42 42 242 51% 1553 14%
80 AdroitChess0.4 JA 1541 44 44 238 48% 1551 11%
81 Leonidas_r83.JA_xb 1502 43 43 238 49% 1502 19%
82 AdroitChess 0.3 1493 45 45 234 49% 1486 15%
83 ZCT-0.3.2500 1480 46 47 232 51% 1456 9%
84 BikJump v2.1P 1470 45 45 234 47% 1486 14%
85 Sjaak_4.68.JA_xb 1465 47 47 228 59% 1352 11%
86 Tscp_1.8.1.AB_xb 1363 47 47 228 48% 1365 11%
87 Zzzzzz_3.5.1.JA_xb 1339 45 46 226 50% 1332 18%
88 Rocinante 2.0 JA 1278 47 47 222 49% 1280 10%
89 VIRUTOR CHESS 1.1.4 1135 48 49 218 38% 1243 11%
90 VIRUTOR CHESS 1.1.1 1132 48 49 218 37% 1243 11%
91 Chess for Android 974 53 57 218 21% 1264 9%
92 Simplex 0.9.8 797 67 59 218 9% 1286 2%
Blitzoid test platform:
* Samsung Galaxy Note II @ 1.6 Ghz without downscaling
* 64MB hash tables where selectable
* 4 cpu threads where selectable
* Own books disabled and replaced by Silver Opening Suite positions (14 of 50 played so far)
* Opening positions played twice with different colors
* Tablebases and ponder off
* GUI: Aart Bik's Chess for Android
* Time control: 5 sec/move
No comments:
Post a Comment