FuryBench Testing Framework

home toIntegralPlentyChessObsidianCaissaQuanticadeSerendipitySpaghetSchoenemannClarityIlluminaPawnocchioVineAnura
Finished
Vine Fury
tree_reuse
diff10.0+0.10
ELO    0.69 +- 10.90 (95%)
LLR    -0.09 (-2.25, 2.89) [0.00, 5.00]
GAMES  N: 1516 W: 434 L: 431 D: 651
PENTA  [38, 149, 372, 170, 29]
Vine Fury
tree_reuse
diff10.0+0.10
ELO    -7.63 +- 20.84 (95%)
LLR    -0.25 (-2.25, 2.89) [0.00, 5.00]
GAMES  N: 410 W: 107 L: 116 D: 187
PENTA  [11, 41, 107, 38, 8]
Anura Vast
hq
diff8.0+0.08
ELO    -4.65 +- 3.97 (95%)
LLR    -2.32 (-2.25, 2.89) [-5.00, 0.00]
GAMES  N: 10752 W: 2796 L: 2940 D: 5016
PENTA  [223, 1178, 2683, 1104, 188]
Caissa Witek
eval-64-38-8
diff10.0+0.10
ELO    -0.25 +- 1.30 (95%)
LLR    -1.83 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 74676 W: 17636 L: 17690 D: 39350
PENTA  [285, 8992, 18855, 8904, 302]
PlentyChess Yoshie2000
[Stockfish] openbench-verbatim
time odds frc diffN=20000
ELO    -47.43 +- 0.19 (95%)
GAMES  N: 10000186/10000000 W: 3080988 L: 4437794 D: 2481404
Quanticade DarkNeutrino
move-picker
diff4.0+0.04
ELO    -12.01 +- 5.51 (95%)
LLR    -2.40 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 3762 W: 811 L: 941 D: 2010
PENTA  [19, 465, 1033, 355, 9]
Schoenemann Jochen
fix/datagen
diff4.0+0.04
ELO    4.66 +- 9.36 (95%)
LLR    0.88 (-2.94, 2.94) [-5.00, 0.00]
GAMES  N: 2164 W: 619 L: 590 D: 955
PENTA  [43, 248, 478, 263, 50]
Anura Vast
datagen
diffN=1000
ELO    -0.03 +- 0.12 (95%)
GAMES  N: 15000294/15000000 W: 3591341 L: 3592603 D: 7816350
Vine Fury
tree_halves_foundation
diff10.0+0.10
ELO    -24.76 +- 9.91 (95%)
LLR    -2.27 (-2.25, 2.89) [0.00, 5.00]
GAMES  N: 998 W: 213 L: 284 D: 501
PENTA  [10, 111, 321, 54, 3]
Vine Fury
main
time odds diff9.0+0.90
ELO    0.50 +- 2.21 (95%)
LLR    0.10 (-2.25, 2.89) [0.00, 5.00]
GAMES  N: 690 W: 201 L: 200 D: 289
PENTA  [0, 2, 340, 3, 0]
Vine Fury
tree_halves_rewrite
diffN=1000
ELO    -0.00 +- 0.00 (95%)
LLR    -1.05 (-2.25, 2.89) [0.00, 5.00]
GAMES  N: 5120 W: 2030 L: 2030 D: 1060
PENTA  [0, 0, 2560, 0, 0]
Vine Fury
tree_halves_rewrite
diffN=500000
ELO    189.73 +- 26.57 (95%)
LLR    2.93 (-2.25, 2.89) [0.00, 5.00]
GAMES  N: 414 W: 231 L: 25 D: 158
PENTA  [0, 9, 41, 99, 58]
Vine Fury
tree_halves_rewrite
diffN=500000
ELO    259.84 +- 31.84 (95%)
LLR    2.93 (-2.25, 2.89) [0.00, 5.00]
GAMES  N: 366 W: 248 L: 16 D: 102
PENTA  [0, 3, 19, 87, 74]
Vine Fury
tree_halves_rewrite
diff10.0+0.10
ELO    -35.72 +- 15.01 (95%)
LLR    -2.30 (-2.25, 2.89) [0.00, 5.00]
GAMES  N: 1064 W: 226 L: 335 D: 503
PENTA  [57, 139, 213, 102, 21]
PlentyChess Yoshie2000
more-policy
diff8.0+0.08
ELO    0.07 +- 1.09 (95%)
LLR    -2.27 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 99276 W: 24084 L: 24063 D: 51129
PENTA  [218, 11643, 25908, 11638, 231]