OpenBench

OpenBench Testing Framework

Finished
Yoshie	PlentyChess	selfgen	diff	N=5000	Generated 1000100/1000000 Games Elo: 0.60 +- 0.59 (95%) [N=1000000] Games: 1000100 W: 376089 L: 374375 D: 249636 [50.086%]
Yoshie	PlentyChess	selfgen-rule50	diff	8.0+0.08	LLR: -2.28 (-2.25, 2.89) [0.00, 3.00] Games: 14860 W: 3225 L: 3329 D: 8306 [49.65%] Ptnml(0-2): 72, 1797, 3773, 1739, 49
Shawn	Serendipity	fix_pv	diff	8.0+0.08	LLR: 0.00 (-2.94, 2.94) [-5.00, 0.00] Games: 0 W: 0 L: 0 D: 0 [0.0%] Ptnml(0-2): 0, 0, 0, 0, 0
Shawn	Serendipity	fix_build_2	diff	8.0+0.08	LLR: 2.98 (-2.94, 2.94) [-5.00, 0.00] Games: 3418 W: 896 L: 790 D: 1732 [51.551%] Ptnml(0-2): 34, 371, 809, 445, 50
Mid	Spaghet	thread-voting	diff	5.0+0.05	LLR: 0.00 (-2.25, 2.89) [0.00, 3.00] Games: 0 W: 0 L: 0 D: 0 [0.0%] Ptnml(0-2): 0, 0, 0, 0, 0
Mid	Spaghet	thread-voting	diff	5.0+0.05	LLR: 0.00 (-2.25, 2.89) [0.00, 3.00] Games: 0 W: 0 L: 0 D: 0 [0.0%] Ptnml(0-2): 0, 0, 0, 0, 0
Mid	Spaghet	thread-voting	diff	4.0+0.04	LLR: 0.00 (-2.25, 2.89) [0.00, 3.00] Games: 0 W: 0 L: 0 D: 0 [0.0%] Ptnml(0-2): 0, 0, 0, 0, 0
Shawn	Serendipity	quiet_only_history	diff	8.0+0.08	LLR: -2.03 (-2.94, 2.94) [0.00, 5.00] Games: 12868 W: 3155 L: 3183 D: 6530 [49.891%] Ptnml(0-2): 170, 1522, 3062, 1526, 154
Shawn	Serendipity	fix_build_2	diff	8.0+0.08	LLR: 0.16 (-2.94, 2.94) [0.00, 5.00] Games: 354 W: 91 L: 83 D: 180 [51.13%] Ptnml(0-2): 4, 42, 78, 48, 5
Aron	Integral	data_generation	diff	8.0+0.08	LLR: -2.28 (-2.25, 2.89) [0.00, 5.00] Games: 548 W: 121 L: 243 D: 184 [38.869%] Ptnml(0-2): 51, 76, 98, 42, 7
ArjunB	Elixir	tt-replacement-3	diff	8.0+0.08	LLR: 2.90 (-2.25, 2.89) [0.00, 3.00] Games: 9854 W: 1662 L: 1460 D: 6732 [51.025%] Ptnml(0-2): 93, 909, 2746, 1061, 118
ArjunB	Elixir	tt-replacement-2	diff	8.0+0.08	LLR: 2.92 (-2.25, 2.89) [0.00, 3.00] Games: 10836 W: 1766 L: 1564 D: 7506 [50.932%] Ptnml(0-2): 82, 1043, 2988, 1201, 104
Yoshie	PlentyChess	selfgen-0025-100	diff	8.0+0.08	LLR: -2.25 (-2.25, 2.89) [0.00, 3.00] Games: 836 W: 148 L: 330 D: 358 [39.115%] Ptnml(0-2): 36, 172, 152, 54, 4
Shawn	Serendipity	fix_build_2	diff	8.0+0.08	LLR: 0.02 (-2.94, 2.94) [0.00, 5.00] Games: 8 W: 2 L: 1 D: 5 [56.25%] Ptnml(0-2): 0, 1, 1, 2, 0
Aron	Integral	data_generation	diff	8.0+0.08	LLR: -2.27 (-2.25, 2.89) [0.00, 5.00] Games: 396 W: 74 L: 215 D: 107 [32.197%] Ptnml(0-2): 56, 62, 51, 25, 4
Shawn	Serendipity	fix_build_2 *	diff	8.0+0.08	LLR: -0.59 (-2.94, 2.94) [0.00, 5.00] Games: 668 W: 181 L: 204 D: 283 [48.278%] Ptnml(0-2): 17, 79, 163, 60, 15
ArjunB	Elixir	tt-replacement-1	diff	8.0+0.08	LLR: -2.27 (-2.25, 2.89) [0.00, 3.00] Games: 1098 W: 106 L: 266 D: 726 [42.714%] Ptnml(0-2): 30, 179, 268, 65, 7
Shawn	Serendipity	fix_build_2	diff	8.0+0.08	LLR: 0.00 (-2.94, 2.94) [0.00, 5.00] Games: 0 W: 0 L: 0 D: 0 [0.0%] Ptnml(0-2): 0, 0, 0, 0, 0
Shawn	Serendipity	fix_build_2	diff	8.0+0.08	LLR: 0.00 (-2.94, 2.94) [0.00, 5.00] Games: 0 W: 0 L: 0 D: 0 [0.0%] Ptnml(0-2): 0, 0, 0, 0, 0
Yoshie	PlentyChess	selfgen	diff	N=5000	Generated 1000084/1000000 Games Elo: -0.03 +- 0.59 (95%) [N=1000000] Games: 1000084 W: 375004 L: 375095 D: 249985 [49.995%]
Aron	Integral	data_generation	diff	8.0+0.08	LLR: -2.26 (-2.25, 2.89) [0.00, 5.00] Games: 526 W: 116 L: 241 D: 169 [38.118%] Ptnml(0-2): 50, 84, 77, 45, 7
DarkNe	Quanticade	smaller-tt-entry	diff	8.0+0.08	LLR: -0.98 (-2.94, 2.94) [0.00, 5.00] Games: 512 W: 103 L: 141 D: 268 [46.289%] Ptnml(0-2): 9, 78, 114, 52, 3
Yoshie	PlentyChess	selfgen	diff	N=5000	Generated 1000124/1000000 Games Elo: 0.11 +- 0.59 (95%) [N=1000000] Games: 1000124 W: 375225 L: 374903 D: 249996 [50.016%]
Yoshie	PlentyChess	selfgen-0025-45	diff	8.0+0.08	LLR: -2.26 (-2.25, 2.89) [0.00, 3.00] Games: 722 W: 107 L: 301 D: 314 [36.565%] Ptnml(0-2): 29, 171, 128, 31, 2
Mid	Spaghet	probcut-improving	diff	40.0+0.40	LLR: -2.27 (-2.25, 2.89) [0.00, 3.00] Games: 58408 W: 14266 L: 14271 D: 29871 [49.996%] Ptnml(0-2): 71, 6429, 16211, 6420, 73

1 2 3 129 130 131 132 133 214 215 216