FuryBench

FuryBench Testing Framework

Home to Integral, PlentyChess, Obsidian, Caissa, Quanticade, Serendipity, Spaghet, Schoenemann, Clarity, and Illumina

Finished
Witek	Caissa	eval-68-29B *	diff	10.0+0.10	LLR: 2.96 (-2.94, 2.94) [0.00, 2.00] Games: 24306 W: 4361 L: 4065 D: 15880 Ptnml(0-2): 143, 2380, 6826, 2646, 158 Elo: 4.23 +- 2.21 (95%)
Witek	Caissa	eval-68-29B	diff	10.0+0.10	LLR: 2.95 (-2.94, 2.94) [0.00, 2.00] Games: 29320 W: 7107 L: 6797 D: 15416 Ptnml(0-2): 92, 3418, 7344, 3700, 106 Elo: 3.67 +- 2.07 (95%)
Swedis	Pawnocchio	history_refactor	diff	10.0+0.10	LLR: 2.94 (-2.25, 2.89) [-3.00, 1.00] Games: 26628 W: 6332 L: 6243 D: 14053 Ptnml(0-2): 36, 3099, 6956, 3186, 37 Elo: 1.16 +- 2.07 (95%)
Witek	Caissa	eval-68-11B	diff	N=25000	LLR: 2.97 (-2.94, 2.94) [0.00, 2.00] Games: 73338 W: 22735 L: 22251 D: 28352 Ptnml(0-2): 1872, 8387, 15770, 8665, 1975 Elo: 2.29 +- 1.67 (95%)
Swedis	Pawnocchio	512_testnet_vine_01_02_data75_piece_relabel.nnue	diff	40.0+0.40	LLR: 2.89 (-2.25, 2.89) [0.00, 3.00] Games: 4426 W: 1235 L: 1049 D: 2142 Ptnml(0-2): 10, 459, 1112, 599, 33 Elo: 14.61 +- 5.38 (95%)
Yoshie	PlentyChess	0134-2r24	diff	40.0+0.40	LLR: 2.89 (-2.25, 2.89) [-1.00, 2.50] Games: 15664 W: 3860 L: 3707 D: 8097 Ptnml(0-2): 2, 1695, 4288, 1842, 5 Elo: 3.39 +- 2.60 (95%)
Yoshie	PlentyChess	0134-2r24	diff	8.0+0.08	LLR: 2.92 (-2.25, 2.89) [0.00, 2.50] Games: 113660 W: 27962 L: 27559 D: 58139 Ptnml(0-2): 165, 13071, 29951, 13482, 161 Elo: 1.23 +- 1.00 (95%)
Swedis	Pawnocchio	[Vine] datagen_conditions	diff	N=12000 *	Elo: 116.36 +- 9.54 (95%) [N=3000] Games: 3072 W: 1558 L: 566 D: 948 Ptnml(0-2): 35, 134, 485, 568, 314
Fury	Integral	[Vine] datagen_conditions	diff	N=5000 *	Elo: 154.28 +- 9.67 (95%) [N=3000] Games: 3072 W: 1687 L: 406 D: 979 Ptnml(0-2): 20, 90, 392, 657, 377
Fury	Vine	datagen_conditions	diff	10.0+0.10	Elo: 63.71 +- 8.18 (95%) [N=3000] Games: 3000 W: 1136 L: 592 D: 1272 Ptnml(0-2): 30, 204, 592, 540, 134
Fury	Integral	[Vine] datagen_conditions	diff	N=20000 *	Elo: 336.49 +- 11.74 (95%) [N=3000] Games: 3072 W: 2337 L: 39 D: 696 Ptnml(0-2): 0, 3, 57, 651, 825
Fury	Vine	datagen_conditions	diff	N=100000	Elo: 65.07 +- 7.79 (95%) [N=3000] Games: 3376 W: 1269 L: 644 D: 1463 Ptnml(0-2): 34, 221, 688, 576, 169
Swedis	Vine	policy_4096hl	diff	10.0+0.10	LLR: 2.92 (-2.25, 2.89) [0.00, 5.00] Games: 2648 W: 657 L: 536 D: 1455 Ptnml(0-2): 15, 262, 659, 363, 25 Elo: 15.89 +- 7.18 (95%)
Swedis	Vine	dual_act	diff	N=10000	LLR: 2.98 (-2.25, 2.89) [0.00, 5.00] Games: 5074 W: 1295 L: 1145 D: 2634 Ptnml(0-2): 78, 551, 1153, 653, 102 Elo: 10.27 +- 5.88 (95%)
Swedis	Vine	main *	diff	N=1000	Elo: -0.00 +- 0.00 (95%) [N=40000] Games: 40158 W: 13552 L: 13552 D: 13054 Ptnml(0-2): 0, 0, 20079, 0, 0
Swedis	Vine	8866140	diff	N=1000	Elo: -0.00 +- 0.00 (95%) [N=40000] Games: 40448 W: 13302 L: 13302 D: 13844 Ptnml(0-2): 0, 0, 20224, 0, 0
Swedis	Vine	3072hl *	diff	10.0+0.10	LLR: 3.15 (-2.25, 2.89) [0.00, 5.00] Games: 1080 W: 321 L: 190 D: 569 Ptnml(0-2): 3, 87, 248, 180, 22 Elo: 42.35 +- 11.80 (95%)
Fury	Integral	[Vine] datagen_conditions	diff	N=20000 *	Elo: 469.01 +- 9.56 (95%) [N=10000] Games: 10122 W: 8899 L: 52 D: 1171 Ptnml(0-2): 0, 1, 56, 1160, 3844
Yoshie	PlentyChess	shared-contcorr	diff	4.0+0.04	LLR: 2.91 (-2.25, 2.89) [0.00, 2.50] Games: 60920 W: 15307 L: 15010 D: 30603 Ptnml(0-2): 45, 6577, 16924, 6864, 50 Elo: 1.69 +- 1.31 (95%)
Fury	Integral	vine_small_adjudicated	diff	10.0+0.10	LLR: 2.90 (-2.25, 2.89) [0.00, 5.00] Games: 2458 W: 686 L: 568 D: 1204 Ptnml(0-2): 7, 263, 576, 371, 12 Elo: 16.69 +- 7.36 (95%)
Yoshie	PlentyChess	i16-score	diff	N=20000	Elo: -0.00 +- 0.00 (95%) [N=10000] Games: 10008 W: 2774 L: 2774 D: 4460 Ptnml(0-2): 0, 0, 5004, 0, 0
Witek	Caissa	simpl_endgame_4	diff	10.0+0.10	LLR: 3.01 (-2.94, 2.94) [-3.00, 0.00] Games: 33996 W: 6330 L: 6261 D: 21405 Ptnml(0-2): 1, 1952, 13026, 2015, 4 Elo: 0.71 +- 1.26 (95%)
Yoshie	PlentyChess	wdl-head	diff	N=20000	Elo: 4.21 +- 4.14 (95%) [N=10000] Games: 10154 W: 2942 L: 2819 D: 4393 Ptnml(0-2): 165, 1156, 2339, 1225, 192
Swedis	Pawnocchio	2048hl	diff	N=20000	LLR: 2.97 (-2.25, 2.89) [0.00, 3.00] Games: 3702 W: 1275 L: 1025 D: 1402 Ptnml(0-2): 84, 375, 736, 519, 137 Elo: 23.50 +- 7.74 (95%)
Witek	Caissa	triple_se_2	diff	80.0+0.80	LLR: 2.97 (-2.94, 2.94) [0.00, 2.50] Games: 25260 W: 5844 L: 5600 D: 13816 Ptnml(0-2): 15, 2778, 6797, 3028, 12 Elo: 3.36 +- 2.07 (95%)

1 2 3 34 35 36