HAL9000

HAL9000
"It just isn't conceivable that you can design a program strong enough to beat players like me."

June 18, 2014

Blitzoid chess engine ratings for Android: TEXEL 1.04 ADDED!

One fair method to compare an engine update vs previous version is to make it play exactly the same games, when this doesn't require thousands of games and very long time.

This had worked well with Stockfish 5 vs Stockfisd DD recently. So, i managed the same process with Texel v1.04 to compare it to Texel v1.03.

Once again, it seemed to be highly efficient.

After 248 games against the same opponents as Texel 1.03, the new version has performed +49 ELO better, reaching 2609 and overtaking Gaviota 1.0 to become #7 among strongest Android chess engines available.

Another usual tendency that was confirmed once again, is that the ELO improvement measured against other engines is lower than the one measured against the previous version of the same engine. That was exactly the same case with Stockfish.

With Texel 1.04 added, we have now 91 engines in Blitzoid ranking. I will be probably adding Discocheck 4.3 to the next release. I'd previously disqualified that version due to engine disconnection problems arising but it may be that my cpu settings at that time caused the error. To follow...

BLITZOID RANKING / 18-JUN-2014
11208 GAMES PLAYED BY 91 PROGRAMS
COMPUTED WITH BAYESELO, OFFSET: 2116
Ra  Name                     Elo   +   -  Gam  Sco  Oppo  Dra
 1  Stockfish 5             3008  41  39  250  78%  2796  31%
 2  Stockfish DD            2974  38  37  250  75%  2796  38%
 3  Stockfish 3             2894  34  34  278  59%  2825  37%
 4  Stockfish 4             2893  34  33  278  60%  2825  46%
 5  Stockfish 2.3.1         2866  34  33  276  56%  2815  45%
 6  Critter 1.4             2854  34  34  276  55%  2817  41%
 7  Critter 1.6a            2852  34  34  276  55%  2815  42%
 8  BlackMamba 2.0          2785  39  39  262  66%  2633  32%
 9  Critter 1.2             2780  37  37  272  57%  2712  33%
10  Stockfish 2.0           2777  36  36  274  51%  2762  31%
11  RobboLito 0.085e4l      2718  36  37  264  44%  2752  35%
12  Komodo32 2.03 JA        2696  37  37  270  45%  2730  30%
13  RobboLito 0.085g3l      2678  37  37  262  54%  2639  32%
14  Senpai 1.0              2665  37  37  266  42%  2720  30%
15  Komodo32 3 AB           2661  37  38  262  47%  2675  27%
16  Texel 1.04              2609  41  40  248  54%  2572  21%
17  Gaviota v1.0            2577  37  37  262  56%  2527  30%
18  Komodo32 1.3 JA         2573  38  39  262  44%  2620  27%
19  Texel 1.03              2560  40  41  248  48%  2572  22%
20  Toga II 3.0             2495  38  38  262  50%  2507  24%
21  IvanHoe 9.46b           2493  40  39  252  54%  2459  23%
22  Arasan 15.2 JA          2422  39  39  252  51%  2421  20%
23  Gaviota v0.86           2407  40  40  248  48%  2434  23%
24  Toga II 1.4.1SE         2384  38  39  254  42%  2458  26%
25  Toga II 2.0 JA          2374  38  38  246  48%  2399  26%
26  DiscoCheck 3.7.1        2366  38  38  252  47%  2394  23%
27  Texel 1.01              2346  38  38  256  43%  2412  24%
28  Arasan 13.4             2331  38  38  246  49%  2345  25%
29  DiscoCheck 4.0.1        2298  38  38  246  47%  2321  28%
30  Arasan 14.0.1           2297  38  38  248  45%  2340  26%
31  Crafty_23.4.JA_xb       2280  38  38  244  50%  2286  24%
32  GNU Chess 5.50-32       2278  38  38  242  46%  2309  29%
33  gaviota v0.84           2269  39  38  242  53%  2252  23%
34  RedQueen 1.1.3 TCEC JA  2252  40  41  246  43%  2312  18%
35  Crafty_23.5.JA_xb       2244  39  40  244  44%  2303  20%
36  Rodent 1.00             2243  38  38  242  53%  2219  30%
37  RedQueen 1.1.2          2242  39  39  244  45%  2290  20%
38  Alfil 12.10 w32         2238  38  38  240  51%  2237  24%
39  Rodent 0.18.0           2216  37  37  244  56%  2171  30%
40  Rotor 0.7a              2206  37  37  242  48%  2223  29%
41  cheng3 1.07 JA          2183  39  39  242  49%  2193  19%
42  Rotor 0.8               2177  38  38  240  49%  2186  25%
43  GarboChess 3            2168  39  38  244  56%  2124  23%
44  Daydreamer 1.75 JA      2164  38  38  242  49%  2167  28%
45  Scorpio_2.7.JA_xb       2160  38  38  242  50%  2158  24%
46  gaviota v0.83           2148  39  39  242  48%  2164  22%
47  Sloppy_0.23.JA_xb       2130  37  38  244  48%  2143  26%
48  Pepito v1.59            2091  39  39  244  49%  2098  21%
49  Danasah_4.88.JA_xb      2075  38  38  244  47%  2093  25%
50  GNU Chess 6.0.2         2068  37  37  244  48%  2075  29%
51  DanasahZ_0.4.JA_xb      2066  38  38  240  49%  2074  26%
52  Tucano_1.04.AB_xb       2061  39  39  244  50%  2061  19%
53  DoubleCheck 2.7         2059  39  39  244  51%  2048  16%
54  DoubleCheck 2.6 JA      2059  39  39  244  50%  2062  18%
55  Danasah_5.06.JA_xb      2029  39  38  240  55%  1983  27%
56  Danasah_4.66.JA_xb      2015  39  39  240  53%  1990  21%
57  Typhoon_1.0.r358.JA_xb  2007  39  39  244  51%  1996  19%
58  BetsabeII_1.30.JA_xb    2006  39  39  244  51%  1995  16%
59  Diablo 0.5.1b JA        1987  38  38  244  52%  1967  25%
60  Olithink_5.3.2.JA_xb    1981  40  40  244  56%  1937  16%
61  Greko_8.2_uci           1967  38  38  240  54%  1941  27%
62  GreKo_9.8.AB_uci        1963  38  38  244  49%  1965  24%
63  GreKo_9.0.JA_uci        1956  39  38  244  53%  1929  20%
64  GreKo_10.0.JA_xb        1942  38  38  244  51%  1933  23%
65  Phalanx_XXIII.JA_xb     1940  40  41  244  46%  1970  13%
66  Sungorus 1.4 JA         1894  40  41  244  49%  1899  16%
67  BetsabeII_1.22.JA_xb    1865  41  41  240  56%  1805  13%
68  TJchess 1.1U            1848  40  40  244  51%  1824  23%
69  Myrddin_0.86.JA_xb      1837  40  40  244  53%  1806  16%
70  Natwarlal_0.14.JA_xb    1814  41  41  244  51%  1797  12%
71  DoubleCheck 2.3         1813  41  41  244  50%  1801  15%
72  KmtChess_1.21.JA_xb     1811  40  40  244  49%  1812  19%
73  Jazz 6.40 JA            1787  40  40  244  46%  1810  20%
74  Scidlet_2.61b2.JA_xb    1755  41  41  244  49%  1755  16%
75  Jazz v444 JA            1742  40  41  244  49%  1745  21%
76  Jazz v5.01 JA           1721  41  41  244  53%  1698  20%
77  Sjeng_1.12.JA_xb        1600  43  43  242  52%  1575  11%
78  BikJump v1.8            1572  42  42  242  51%  1555  14%
79  AdroitChess0.4 JA       1543  44  44  238  48%  1553  11%
80  Leonidas_r83.JA_xb      1504  43  43  238  49%  1504  19%
81  AdroitChess 0.3         1495  45  45  234  49%  1488  15%
82  ZCT-0.3.2500            1482  46  47  232  51%  1458   9%
83  BikJump v2.1P           1472  45  45  234  47%  1488  14%
84  Sjaak_4.68.JA_xb        1467  47  47  228  59%  1354  11%
85  Tscp_1.8.1.AB_xb        1365  47  47  228  48%  1367  11%
86  Zzzzzz_3.5.1.JA_xb      1341  45  46  226  50%  1334  18%
87  Rocinante 2.0 JA        1280  47  47  222  49%  1282  10%
88  VIRUTOR CHESS 1.1.4     1137  48  49  218  38%  1245  11%
89  VIRUTOR CHESS 1.1.1     1133  48  49  218  37%  1245  11%
90  Chess for Android        976  53  57  218  21%  1266   9%
91  Simplex 0.9.8            799  67  61  218   9%  1288   2%

Blitzoid test platform:
* Samsung Galaxy Note II @ 1.6 Ghz without downscaling
* 64MB hash tables where selectable
* 4 cpu threads where selectable
* Own books disabled and replaced by Silver Opening Suite positions (14 of 50 played so far)
* Opening positions played twice with different colors
* Tablebases and ponder off
* GUI: Aart Bik's Chess for Android
* Time control: 5 sec/move

4 comments:

Unknown said...

Add android chess UCI engine rhetoric 1.4

Unknown said...

Thanks for the info. Will be my pleasure, as soon as i find and download the file.

Unknown said...

Thank you, web site chessrhetoric.com

Unknown said...

A bullet test result is submitted a new post. Now I need around one week to add it in Blitzoid ranking. It needs more than 200 games.