FuryBench Testing Framework

home toIntegralPlentyChessObsidianCaissaQuanticadeSerendipitySpaghetSchoenemannClarityIlluminaPawnocchioVineAnura
Finished
Schoenemann Jochen
feature/cleanup-exiting
crash diff1.0+0.01
ELO    1.11 +- 2.80 (95%)
GAMES  N: 25056/25000 W: 9399 L: 9319 D: 6338
PENTA  [852, 1848, 7070, 1884, 874]
Schoenemann Jochen
feature/cleanup-exiting
diff8.0+0.08
ELO    -0.55 +- 1.92 (95%)
LLR    2.96 (-2.94, 2.94) [-5.00, 0.00]
GAMES  N: 45232 W: 17208 L: 17280 D: 10744
PENTA  [1312, 2936, 14201, 2846, 1321]
Schoenemann Jochen
feature/qs-tt
diff8.0+0.08
ELO    -4.41 +- 5.25 (95%)
LLR    -2.95 (-2.94, 2.94) [0.00, 5.00]
GAMES  N: 8040 W: 3070 L: 3172 D: 1798
PENTA  [355, 594, 2184, 572, 315]
Schoenemann Jochen
feature/pvs
diff8.0+0.08
ELO    277.99 +- 43.10 (95%)
LLR    3.20 (-2.94, 2.94) [0.00, 5.00]
GAMES  N: 390 W: 317 L: 58 D: 15
PENTA  [0, 0, 58, 15, 122]
Schoenemann Jochen
feature/tt
diff8.0+0.08
ELO    85.78 +- 17.07 (95%)
LLR    3.03 (-2.94, 2.94) [0.00, 5.00]
GAMES  N: 624 W: 372 L: 221 D: 31
PENTA  [1, 1, 218, 30, 62]
Schoenemann Jochen
feature/qs
diff8.0+0.08
ELO    88.48 +- 21.59 (95%)
LLR    2.98 (-2.94, 2.94) [0.00, 5.00]
GAMES  N: 718 W: 414 L: 235 D: 69
PENTA  [16, 26, 180, 37, 100]
Schoenemann Jochen
feature/moveorder
diff8.0+0.08
ELO    318.89 +- 47.97 (95%)
LLR    3.21 (-2.94, 2.94) [0.00, 5.00]
GAMES  N: 378 W: 307 L: 33 D: 38
PENTA  [1, 0, 35, 30, 123]
Schoenemann Jochen
feature/pure-negamax
diff8.0+0.08
ELO    -1.22 +- 10.47 (95%)
GAMES  N: 2000/2000 W: 517 L: 524 D: 959
PENTA  [64, 233, 399, 254, 50]
Schoenemann Jochen
feature/triple-extensions
diff1.0+0.01
ELO    -16.48 +- 9.05 (95%)
LLR    -3.07 (-2.94, 2.94) [0.00, 5.00]
GAMES  N: 2912 W: 852 L: 990 D: 1070
PENTA  [123, 361, 591, 293, 88]
Schoenemann Jochen
feature/2-ply-cont-hist
diff8.0+0.08
ELO    -0.11 +- 3.00 (95%)
LLR    -2.05 (-2.94, 2.94) [0.00, 5.00]
GAMES  N: 18406 W: 4862 L: 4868 D: 8676
PENTA  [260, 2247, 4199, 2233, 264]
Schoenemann Jochen
main
diff40.0+0.40
ELO    105.63 +- 12.85 (95%)
GAMES  N: 1000/1000 W: 402 L: 107 D: 491
PENTA  [1, 33, 184, 234, 48]
Schoenemann Jochen
fix/qs-depth-condition
diff8.0+0.08
ELO    3.02 +- 2.43 (95%)
LLR    2.96 (-2.94, 2.94) [0.00, 5.00]
GAMES  N: 26838 W: 7111 L: 6878 D: 12849
PENTA  [294, 3204, 6277, 3263, 381]
Schoenemann Jochen
fix/wrong-tt-depth
diff8.0+0.08
ELO    1.35 +- 3.27 (95%)
LLR    2.96 (-2.94, 2.94) [-5.00, 0.00]
GAMES  N: 14882 W: 3877 L: 3819 D: 7186
PENTA  [202, 1723, 3531, 1785, 200]
Schoenemann Jochen
cleanup/alignas
diff8.0+0.08
ELO    6.37 +- 5.41 (95%)
LLR    3.00 (-2.94, 2.94) [-5.00, 0.00]
GAMES  N: 5400 W: 1437 L: 1338 D: 2625
PENTA  [63, 619, 1236, 720, 62]
Schoenemann Jochen
feature/gives-check
diff8.0+0.08
ELO    -9.98 +- 6.60 (95%)
LLR    -2.96 (-2.94, 2.94) [0.00, 5.00]
GAMES  N: 3690 W: 884 L: 990 D: 1816
PENTA  [38, 528, 831, 398, 50]
Schoenemann Jochen
feature/lmr-gives-check
diff8.0+0.08
ELO    -13.72 +- 7.61 (95%)
LLR    -3.04 (-2.94, 2.94) [0.00, 5.00]
GAMES  N: 2914 W: 712 L: 827 D: 1375
PENTA  [49, 405, 651, 316, 36]
Schoenemann Jochen
feature/gives-check
diff8.0+0.08
ELO    -1.50 +- 3.35 (95%)
LLR    -2.97 (-2.94, 2.94) [0.00, 5.00]
GAMES  N: 14124 W: 3651 L: 3712 D: 6761
PENTA  [198, 1689, 3307, 1712, 156]
Schoenemann Jochen
feature/gives-check
diff8.0+0.08
ELO    -9.03 +- 6.28 (95%)
LLR    -2.98 (-2.94, 2.94) [0.00, 5.00]
GAMES  N: 4004 W: 1005 L: 1109 D: 1890
PENTA  [57, 523, 929, 453, 40]
Schoenemann Jochen
feature/gives-check
diff8.0+0.08
ELO    -1.64 +- 3.39 (95%)
LLR    -2.96 (-2.94, 2.94) [0.00, 5.00]
GAMES  N: 13338 W: 3400 L: 3463 D: 6475
PENTA  [166, 1608, 3153, 1607, 135]
Schoenemann Jochen
r2
diff8.0+0.08
ELO    -0.81 +- 2.94 (95%)
LLR    -2.97 (-2.94, 2.94) [0.00, 5.00]
GAMES  N: 18446 W: 4755 L: 4798 D: 8893
PENTA  [237, 2272, 4221, 2283, 210]
Schoenemann Jochen
r1
diff8.0+0.08
ELO    -6.94 +- 5.62 (95%)
LLR    -2.96 (-2.94, 2.94) [0.00, 5.00]
GAMES  N: 4954 W: 1212 L: 1311 D: 2431
PENTA  [64, 638, 1163, 557, 55]