FuryBench Testing Framework

home toIntegralPlentyChessObsidianCaissaQuanticadeSerendipitySpaghetSchoenemannClarityIlluminaPawnocchioVineAnura
Finished
Vine Fury
less_exploration
diff40.0+0.40
ELO    -5.57 +- 6.19 (95%)
LLR    -2.29 (-2.25, 2.89) [0.00, 5.00]
GAMES  N: 4924 W: 1126 L: 1205 D: 2593
PENTA  [111, 607, 1095, 548, 101]
Caissa Witek
eval-64-13
frc diff10.0+0.10
ELO    -1.82 +- 1.77 (95%)
LLR    -2.99 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 40216 W: 7257 L: 7468 D: 25491
PENTA  [331, 4307, 11009, 4164, 297]
Vine Fury
more_exploration
diff40.0+0.40
ELO    -7.92 +- 7.10 (95%)
LLR    -2.27 (-2.25, 2.89) [0.00, 5.00]
GAMES  N: 3640 W: 779 L: 862 D: 1999
PENTA  [78, 455, 832, 382, 73]
Anura Vast
datagen-notr
diffN=1000
ELO    0.06 +- 0.22 (95%)
GAMES  N: 5000260/5000000 W: 1268094 L: 1267248 D: 2464918
Vine Fury
less_exploration
diff10.0+0.10
ELO    17.15 +- 8.58 (95%)
LLR    3.01 (-2.25, 2.89) [0.00, 5.00]
GAMES  N: 3608 W: 1242 L: 1064 D: 1302
PENTA  [139, 350, 685, 454, 176]
Vine Fury
more_exploration
diff10.0+0.10
ELO    -13.75 +- 9.97 (95%)
LLR    -2.27 (-2.25, 2.89) [0.00, 5.00]
GAMES  N: 2630 W: 781 L: 885 D: 964
PENTA  [127, 314, 506, 272, 96]
Vine Fury
root_pst
diff10.0+0.10
ELO    20.05 +- 9.37 (95%)
LLR    2.93 (-2.25, 2.89) [0.00, 5.00]
GAMES  N: 2862 W: 986 L: 821 D: 1055
PENTA  [84, 302, 550, 355, 140]
Vine Fury
root_pst
diff10.0+0.10
ELO    -11.91 +- 12.64 (95%)
LLR    -1.15 (-2.25, 2.89) [0.00, 5.00]
GAMES  N: 1430 W: 349 L: 398 D: 683
PENTA  [45, 201, 266, 164, 39]
Vine Fury
root_pst
diff10.0+0.10
ELO    -6.78 +- 7.63 (95%)
LLR    -1.92 (-2.25, 2.89) [0.00, 5.00]
GAMES  N: 3742 W: 964 L: 1037 D: 1741
PENTA  [108, 485, 755, 418, 105]
Vine Fury
combined_v18_p2
diff10.0+0.10
ELO    -0.71 +- 5.88 (95%)
LLR    -1.18 (-2.25, 2.89) [0.00, 5.00]
GAMES  N: 8376 W: 2848 L: 2865 D: 2663
PENTA  [450, 854, 1564, 903, 417]
PlentyChess Yoshie2000
no-low-ttvalue-negext
diff8.0+0.08
ELO    1.64 +- 1.29 (95%)
LLR    2.91 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 70486 W: 17311 L: 16979 D: 36196
PENTA  [156, 8158, 18312, 8432, 185]
PlentyChess Yoshie2000
[Stockfish] openbench-verbatim
crash time odds diffN=20000
ELO    11.97 +- 0.18 (95%)
GAMES  N: 10000040/10000000 W: 3829270 L: 3484989 D: 2685781
Integral Fury
cuckoo_qs_again
diff10.0+0.10
ELO    -0.49 +- 1.55 (95%)
LLR    -2.26 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 49300 W: 12185 L: 12254 D: 24861
PENTA  [133, 5780, 12899, 5699, 139]
Vine SwedishChef
policy_max_fix
diff10.0+0.10
ELO    0.10 +- 1.29 (95%)
LLR    0.48 (-2.25, 2.89) [-5.00, 0.00]
GAMES  N: 3386 W: 1018 L: 1017 D: 1351
PENTA  [0, 20, 1652, 21, 0]
Vine SwedishChef
policy
diff10.0+0.10
ELO    316.76 +- 46.24 (95%)
LLR    3.50 (-2.25, 2.89) [0.00, 5.00]
GAMES  N: 410 W: 323 L: 27 D: 60
PENTA  [0, 7, 26, 41, 131]