FuryBench

FuryBench Testing Framework

Home to Integral, PlentyChess, Obsidian, Caissa, Quanticade, Serendipity, Spaghet, Schoenemann, Clarity, and Illumina

Finished
Swedis	Pawnocchio	multilayer	diff	10.0+0.10	Elo: -54.40 +- 13.87 (95%) [N=10000] Games: 734 W: 129 L: 243 D: 362 Ptnml(0-2): 13, 139, 165, 49, 1
Swedis	Pawnocchio	multilayer	diff	N=40000	LLR: 3.03 (-2.25, 2.89) [0.00, 3.00] Games: 1694 W: 605 L: 376 D: 713 Ptnml(0-2): 12, 138, 366, 271, 60 Elo: 47.26 +- 10.38 (95%)
Swedis	Pawnocchio	mixed_data_2048pw_higher_wdl.nnue	diff	10.0+0.10	LLR: -0.44 (-2.25, 2.89) [0.00, 3.00] Games: 8260 W: 2035 L: 2043 D: 4182 Ptnml(0-2): 30, 1034, 2005, 1036, 25 Elo: -0.34 +- 3.95 (95%)
Swedis	Pawnocchio	mixed_data_2048pw_higher_wdl.nnue	diff	40.0+0.40	LLR: 2.89 (-2.25, 2.89) [0.00, 3.00] Games: 41152 W: 9819 L: 9567 D: 21766 Ptnml(0-2): 34, 4709, 10834, 4969, 30 Elo: 2.13 +- 1.65 (95%)
Swedis	Pawnocchio	mixed_data_2048pw_lower.nnue	diff	10.0+0.10	LLR: -1.05 (-2.25, 2.89) [0.00, 3.00] Games: 11172 W: 2684 L: 2722 D: 5766 Ptnml(0-2): 43, 1344, 2829, 1348, 22 Elo: -1.18 +- 3.31 (95%)
Swedis	Pawnocchio	mixed_data_2048pw_lower.nnue	diff	40.0+0.40	LLR: -0.24 (-2.25, 2.89) [0.00, 3.00] Games: 22650 W: 5333 L: 5299 D: 12018 Ptnml(0-2): 10, 2617, 6048, 2629, 21 Elo: 0.52 +- 2.20 (95%)
Swedis	Pawnocchio	mixed_data_2048pw_shorter.nnue	diff	10.0+0.10	LLR: -2.26 (-2.25, 2.89) [-3.00, 1.00] Games: 4022 W: 934 L: 1040 D: 2048 Ptnml(0-2): 11, 535, 1022, 435, 8 Elo: -9.16 +- 5.47 (95%)
Swedis	Pawnocchio	512_testnet_vine_01_13_2.nnue	diff	10.0+0.10	LLR: -1.37 (-2.25, 2.89) [0.00, 3.00] Games: 34290 W: 8930 L: 8936 D: 16424 Ptnml(0-2): 220, 4130, 8419, 4188, 188 Elo: -0.06 +- 1.98 (95%)
Swedis	Pawnocchio	512_testnet_vine_01_13_2.nnue	diff	40.0+0.40	LLR: 2.96 (-2.25, 2.89) [0.00, 3.00] Games: 14420 W: 3709 L: 3503 D: 7208 Ptnml(0-2): 24, 1666, 3626, 1868, 26 Elo: 4.96 +- 2.88 (95%)
Swedis	Pawnocchio	512_testnet_vine_01_13.nnue	diff	10.0+0.10	LLR: -2.26 (-2.25, 2.89) [0.00, 3.00] Games: 5676 W: 1404 L: 1536 D: 2736 Ptnml(0-2): 46, 756, 1365, 626, 45 Elo: -8.08 +- 5.01 (95%)
Swedis	Vine	wdl_outputs *	diff	10.0+0.10	LLR: -2.29 (-2.25, 2.89) [0.00, 5.00] Games: 406 W: 51 L: 172 D: 183 Ptnml(0-2): 32, 84, 60, 27, 0 Elo: -106.79 +- 24.46 (95%)
Swedis	Pawnocchio	512_testnet_vine_01_12_2.nnue	diff	10.0+0.10	LLR: -2.26 (-2.25, 2.89) [0.00, 3.00] Games: 28528 W: 7458 L: 7536 D: 13534 Ptnml(0-2): 248, 3544, 6757, 3468, 247 Elo: -0.95 +- 2.26 (95%)
Swedis	Pawnocchio	512_testnet_vine_01_12_2.nnue	diff	40.0+0.40	LLR: -2.29 (-2.25, 2.89) [0.00, 3.00] Games: 6176 W: 1504 L: 1625 D: 3047 Ptnml(0-2): 13, 807, 1565, 694, 9 Elo: -6.81 +- 4.39 (95%)
Swedis	Vine	wdl_outputs	diff	10.0+0.10	LLR: -2.27 (-2.25, 2.89) [0.00, 5.00] Games: 728 W: 127 L: 222 D: 379 Ptnml(0-2): 12, 139, 150, 58, 5 Elo: -45.60 +- 14.89 (95%)
Swedis	Vine	wdl_outputs	diff	N=10000	LLR: -2.54 (-2.25, 2.89) [0.00, 5.00] Games: 816 W: 169 L: 285 D: 362 Ptnml(0-2): 35, 131, 166, 67, 9 Elo: -49.73 +- 15.89 (95%)
Swedis	Pawnocchio	512_testnet_vine_01_12.nnue	diff	40.0+0.40	LLR: 2.90 (-2.25, 2.89) [0.00, 3.00] Games: 28380 W: 7264 L: 7032 D: 14084 Ptnml(0-2): 54, 3316, 7211, 3562, 47 Elo: 2.84 +- 2.05 (95%)
Swedis	Pawnocchio	512_testnet_vine_01_12.nnue	diff	10.0+0.10	LLR: -0.12 (-2.25, 2.89) [0.00, 3.00] Games: 16380 W: 4173 L: 4143 D: 8064 Ptnml(0-2): 81, 1971, 4059, 1995, 84 Elo: 0.64 +- 2.83 (95%)
Swedis	Pawnocchio	512_testnet_vine_01_11.nnue	diff	10.0+0.10	LLR: 2.92 (-2.25, 2.89) [0.00, 3.00] Games: 41814 W: 11089 L: 10806 D: 19919 Ptnml(0-2): 325, 4858, 10179, 5299, 246 Elo: 2.35 +- 1.82 (95%)
Swedis	Pawnocchio	2048pw	diff	10.0+0.10	LLR: 2.92 (-2.25, 2.89) [0.00, 3.00] Games: 37942 W: 9374 L: 9120 D: 19448 Ptnml(0-2): 75, 4416, 9746, 4648, 86 Elo: 2.33 +- 1.77 (95%)
Swedis	Pawnocchio	512_testnet_vine_01_11.nnue	diff	40.0+0.40	LLR: 2.96 (-2.25, 2.89) [0.00, 3.00] Games: 6334 W: 1721 L: 1532 D: 3081 Ptnml(0-2): 13, 676, 1599, 867, 12 Elo: 10.37 +- 4.35 (95%)
Swedis	Pawnocchio	2048pw	diff	N=10000	LLR: 3.07 (-2.25, 2.89) [0.00, 3.00] Games: 7740 W: 2801 L: 2512 D: 2427 Ptnml(0-2): 287, 752, 1600, 847, 384 Elo: 12.98 +- 5.76 (95%)
Swedis	Pawnocchio	2048hl_scaled	diff	10.0+0.10	LLR: -1.43 (-2.25, 2.89) [0.00, 3.00] Games: 3822 W: 869 L: 946 D: 2007 Ptnml(0-2): 10, 506, 955, 431, 9 Elo: -7.00 +- 5.67 (95%)
Swedis	Pawnocchio	2048hl_scaled	diff	40.0+0.40	LLR: -1.53 (-2.25, 2.89) [0.00, 3.00] Games: 6174 W: 1421 L: 1495 D: 3258 Ptnml(0-2): 6, 760, 1627, 690, 4 Elo: -4.16 +- 4.26 (95%)
Swedis	Pawnocchio	2048hl_scaled	diff	N=20000	Elo: 6.33 +- 6.79 (95%) [N=10000] Games: 4774 W: 1580 L: 1493 D: 1701 Ptnml(0-2): 139, 521, 992, 584, 151
Swedis	Vine	combined_v57_p20_test4	diff	10.0+0.10	LLR: -2.25 (-2.25, 2.89) [0.00, 5.00] Games: 4290 W: 929 L: 1001 D: 2360 Ptnml(0-2): 41, 568, 1005, 484, 47 Elo: -5.83 +- 5.95 (95%)

1 2 3 10 11 12