Just after a couple of months elapsed, today i can finally issue the first outcome of RAPIDROID experiment. It's premature but shareable.
Rapidroid brings more demanding and time consuming improvements over Blitzoid project, suspended after about 16000 games by 93 programs, due to stabilized ranking.
Now it's time to search for more fun, more complexity, (more headache?). No doubt, similarities with famous SSDF rankings may be found. However my main concern is to add more colour with unseen combinations and pairings, more free programs and take good care of all programs, not only the toppers and recent releases. By default, Rapidroid is free from most of the critics SSDF had recieved in time.
So what's new in the menu?
> Six times longer time control, at 30 seconds/move or similar. Simply better chess!
> A true multiplatform, not limited to Android UCI/XB engines. Instead, all DOS, Windows Mobile, IOS programs, as well as tabletops are welcome.
> Travel in time: We can't forget the old goodies. They can still play chess, no matter how weak. By the way, we will see how weak they were.
> A device-based ranking to measure how much force can be gained by using modern hardware with older programs especially. Experiments like Commodore-64 @ 100X or Fritz 5.32 on Intel-i7 or old Mephisto's running at full PC speed via emulators should be interesting to try.
> Android UCI/XB engines which didn't work in automated tournament mode of Chess for Android can be included by playing manual games under Droidfish!
> And finally we can rate all standalone programs, not only Android versions of Shredder, Chess Genius etc but also Mobialia, CNVCS, Senior Chess and many others. They all claim to be the best in the market (?) but none was seriously tested and rated. So, i take this job.
The first ranking below is the result of just two rounds and 16 to 20 games per engine. For the moment, i started the same way as Blitzoid, with only Android UCI/XB engines. Once the error margins go below +/-100, other programs will join the ranking one by one, via gauntlets of 10 to 20 games.
We have Komodo 8, Firenzina 2.41 and Discocheck 4.3 as new engines introduced. Seeing the brand new Komodo 8 taking first place here should not be alarming. Only a few games have been played yet and it may be temporary, just related to a specific opening.
The list is calibrated in parallel to Blitzoid in such a way to ensure minimum overall difference between two lists. This gives an offset of 2306 for 56 engines included so far.
Ra Name Elo + - Ga Sco Oppo Dra
1 Komodo 8 3199 125 114 20 73% 3069 45%
2 Stockfish 5 3186 125 116 20 70% 3071 40%
3 Critter 1.6a 3118 114 112 20 55% 3085 50%
4 Firenzina 2.4.1 xTreme 3071 110 112 20 45% 3094 60%
5 BlackMamba 2.0 3061 129 124 18 58% 3003 39%
6 Komodo32 3 AB 3022 130 130 18 53% 2986 39%
7 Senpai 1.0 2952 133 128 16 63% 2884 50%
8 Gaviota v1.0-d 2930 135 145 18 39% 3006 11%
9 RobboLito 0.085e4l 2924 125 135 18 31% 3033 39%
10 Texel 1.04 2845 147 139 16 59% 2788 19%
11 Arasan 15.2 JA 2828 132 135 16 47% 2851 31%
12 DiscoCheck 4.3 2825 134 135 16 47% 2851 31%
13 Toga II 3.0 2748 125 125 16 50% 2748 50%
14 Crafty_23.4.JA_xb 2747 127 124 16 56% 2720 50%
15 GNU Chess 5.50 2722 124 125 16 50% 2726 50%
16 RedQueen 1.1.3 TCEC JA 2710 132 128 16 59% 2671 44%
17 Rhetoric 1.4 2665 127 129 16 47% 2682 44%
18 Daydreamer 1.75 JA 2651 134 130 16 56% 2604 38%
19 Rodent 1.00 2642 132 133 16 47% 2660 31%
20 IvanHoe 9.46b 2640 141 164 16 19% 2839 25%
21 Rotor 0.7a 2623 133 128 16 59% 2565 44%
22 Sloppy_0.23.JA_xb 2618 130 130 16 50% 2613 38%
23 GarboChess 3 2553 124 121 16 56% 2530 63%
24 Alfil 12.10 2541 126 130 16 41% 2586 44%
25 cheng3 1.07 JA 2506 134 129 16 59% 2457 44%
26 GNU Chess 6.0.2 2452 132 131 16 53% 2419 44%
27 Scorpio_2.7.JA_xb 2428 128 133 16 41% 2476 44%
28 Pepito v1.59 2420 130 132 16 47% 2427 44%
29 DanasahZ_0.4.JA_xb 2364 137 138 16 50% 2356 25%
30 GreKo_9.0.JA_uci 2316 135 134 16 53% 2295 31%
31 Olithink_5.3.2.JA_xb 2295 132 132 16 50% 2300 38%
32 Tucano_1.04.AB_xb 2271 148 144 16 53% 2243 6%
33 BetsabeII_1.30.JA_xb 2177 146 141 16 56% 2128 13%
34 Diablo 0.5.1b JA 2171 144 147 16 47% 2195 6%
35 DoubleCheck 2.7 2161 150 163 16 34% 2270 6%
36 Typhoon_1.0.r358.JA_xb 2124 135 137 16 47% 2141 31%
37 Sungorus 1.4 JA 2110 141 141 16 50% 2110 13%
38 TJchess 1.1U 2104 131 131 16 50% 2112 38%
39 Natwarlal_0.14.JA_xb 2060 143 143 16 50% 2058 13%
40 Phalanx_XXIII.JA_xb 2059 153 142 16 66% 1942 19%
41 KmtChess_1.21.JA_xb 1971 148 146 16 53% 1938 19%
42 Jazz 6.40 JA 1962 145 146 16 53% 1940 19%
43 Myrddin_0.86.JA_xb 1953 147 151 16 47% 1968 6%
44 Scidlet_2.61b2.JA_xb 1940 158 149 16 63% 1830 13%
45 AdroitChess0.4 JA 1743 151 151 16 50% 1756 13%
46 Leonidas_r83.JA_xb 1691 148 135 16 69% 1564 25%
47 ZCT-0.3.2500 1669 149 160 16 38% 1774 13%
48 BikJump v1.8 1642 142 147 16 41% 1700 31%
49 Sjeng_1.12.JA_xb 1638 149 154 16 44% 1701 25%
50 Sjaak_4.68.JA_xb 1584 163 158 16 66% 1409 19%
51 Tscp_1.8.1.AB_xb 1478 157 166 16 50% 1435 13%
52 Zzzzzz_3.5.1.JA_xb 1428 164 162 16 56% 1355 13%
53 VIRUTOR CHESS 1.1.1 1330 157 165 16 44% 1380 13%
54 Rocinante 2.0 JA 1226 166 166 16 50% 1224 0%
55 Chess for Android 1085 158 143 16 28% 1259 6%
56 Simplex 0.9.8 900 214 -20 16 6% 1305 0%
Rapidroid test platform:
* Samsung N7100 @ 1.6Ghz * 4 cores, 256MB hash for SP & MP Android programs,
* Polypad 1010IPS @ 1.6Ghz * 2 cores + 128MB hash for SP Android programs,
* HTC Diamond @ 528Mhz + 16MB hash for Windows Mobile programs,
* i7 M620 @ 2.67 Ghz + Arena 3.5 + 2GB hash for Windows programs
* iPod Touch 64G @ 600 Mhz for IOS programs,
* DosBox 1.74 used to run DOS programs,
* WinVICE used to run Commodore-64 programs,
* Messtiny UCI adapters or CB-Emu2014 used to emulate Mephisto programs,
* Openings selected from Adam Hair's 10 move book for continous variety, without queens exchange & verified between -0.10 and +0.40 cp evaluation.
* Opening positions played twice with different colors, whenever possible.
* Repeating openings and twin games are not allowed between two programs.
* Tablebases and pondering are disabled.
* Time control: 1/30 or 15'+10" or 1800" or closest rapid chess timings.
No comments:
Post a Comment