FuryBench Testing Framework

home toIntegralPlentyChessObsidianCaissaQuanticadeSerendipitySpaghetSchoenemannClarityIlluminaPawnocchioVineAnura
Active : 33 Machines / 790 Threads / 455.42 MNPS
Priority 0
PlentyChess Yoshie2000
refuted-by-probcut
diff40.0+0.40
ELO    0.79 +- 1.83 (95%)
LLR    0.26 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 31280 W: 7625 L: 7554 D: 16101
PENTA  [6, 3476, 8606, 3545, 7]
Quanticade DarkNeutrino
[Stockfish] master
Adv datagen vs SF 6000 fixed nodes
time odds diffN=5000
ELO    -5.36 +- 0.24 (95%)
GAMES  N: 6479518/10000000 W: 2451278 L: 2551314 D: 1476926
Integral Fury
factorised-ob
diff40.0+0.40
ELO    0.52 +- 7.41 (95%)
LLR    -0.02 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 1998 W: 475 L: 472 D: 1051
PENTA  [1, 230, 534, 233, 1]
Caissa Witek
hmc-input
Eval: Half-move counter inputs (net version 16) Net format version 16 adds 12 feature transformer rows after the piece inputs: bucket b = min(hmc / 8, 12) activates row b - 1 in both perspectives, no row below hmc 8. The incremental update compares the bucket at the two ends of the update path; the accumulator cache stays piece-only and the row is added when a node is built from it. `utils upgradeNet` converts a version 15 net with zero rows, which is an exact no-op (bench 5907427, same as master). Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
diff10.0+0.10
ELO    -4.52 +- 2.59 (95%)
LLR    -1.90 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 8078 W: 2661 L: 2766 D: 2651
PENTA  [1, 522, 3097, 419, 0]
Caissa Witek
hmc-input
Eval: Half-move counter inputs (net version 16) Net format version 16 adds 12 feature transformer rows after the piece inputs: bucket b = min(hmc / 8, 12) activates row b - 1 in both perspectives, no row below hmc 8. The incremental update compares the bucket at the two ends of the update path; the accumulator cache stays piece-only and the row is added when a node is built from it. `utils upgradeNet` converts a version 15 net with zero rows, which is an exact no-op (bench 5907427, same as master). Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
diff10.0+0.10
ELO    -8.89 +- 3.70 (95%)
LLR    -2.43 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 7312 W: 1702 L: 1889 D: 3721
PENTA  [0, 884, 2078, 691, 3]
Finished
Integral Fury
factorised-ob
diff10.0+0.10
ELO    -1.66 +- 2.49 (95%)
LLR    -2.27 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 19102 W: 4619 L: 4710 D: 9773
PENTA  [57, 2269, 4977, 2204, 44]
Integral Fury
factorised-ob
diffN=20000
ELO    1.81 +- 1.35 (95%)
LLR    3.44 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 95164 W: 27140 L: 26645 D: 41379
PENTA  [1523, 11399, 21319, 11742, 1599]
Integral Fury
non_capthist_malus_decay
diff40.0+0.40
ELO    1.95 +- 1.53 (95%)
LLR    2.89 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 44314 W: 10913 L: 10664 D: 22737
PENTA  [11, 4783, 12323, 5026, 14]
PlentyChess Yoshie2000
refuted-by-probcut
diff8.0+0.08
ELO    1.01 +- 0.80 (95%)
LLR    2.91 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 180496 W: 44044 L: 43519 D: 92933
PENTA  [280, 21019, 47108, 21578, 263]
Integral Fury
limit_history_static_eval_updates
diff10.0+0.10
ELO    -0.74 +- 2.37 (95%)
LLR    -1.53 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 20620 W: 4992 L: 5036 D: 10592
PENTA  [42, 2426, 5420, 2378, 44]
PlentyChess Yoshie2000
0193
diff8.0+0.08
ELO    0.18 +- 2.12 (95%)
LLR    -0.48 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 26306 W: 6500 L: 6486 D: 13320
PENTA  [49, 3137, 6773, 3139, 55]
PlentyChess Yoshie2000
0193
diff40.0+0.40
ELO    -2.74 +- 2.93 (95%)
LLR    -1.81 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 12692 W: 3060 L: 3160 D: 6472
PENTA  [1, 1530, 3390, 1418, 7]
Integral Fury
non_capthist_malus_decay
diff10.0+0.10
ELO    4.39 +- 2.69 (95%)
LLR    2.90 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 15980 W: 4076 L: 3874 D: 8030
PENTA  [20, 1788, 4189, 1956, 37]
PlentyChess Yoshie2000
0193
diffN=20000
ELO    1.89 +- 1.50 (95%)
LLR    2.91 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 73532 W: 20653 L: 20254 D: 32625
PENTA  [972, 8876, 16790, 9037, 1091]
Integral Fury
pc_imp_depth
diff10.0+0.10
ELO    -2.12 +- 2.69 (95%)
LLR    -2.26 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 15754 W: 3899 L: 3995 D: 7860
PENTA  [32, 1862, 4183, 1770, 30]
Integral Fury
seval_overestimate_lmr
diff10.0+0.10
ELO    -2.31 +- 4.64 (95%)
LLR    -0.81 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 5274 W: 1317 L: 1352 D: 2605
PENTA  [6, 636, 1391, 595, 9]
Integral Fury
d12_fp
diff10.0+0.10
ELO    0.93 +- 1.64 (95%)
LLR    0.40 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 42762 W: 10629 L: 10514 D: 21619
PENTA  [71, 4935, 11266, 5026, 83]
PlentyChess Yoshie2000
0193
diff8.0+0.08
ELO    6.58 +- 3.17 (95%)
LLR    2.89 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 11990 W: 3139 L: 2912 D: 5939
PENTA  [24, 1333, 3070, 1528, 40]
PlentyChess Yoshie2000
0193
diffN=20000
ELO    10.12 +- 2.89 (95%)
GAMES  N: 20014/20000 W: 6045 L: 5462 D: 8507
PENTA  [254, 2209, 4595, 2598, 351]
PlentyChess Yoshie2000
probcut-hist-update
diff8.0+0.08
ELO    -0.24 +- 1.35 (95%)
LLR    -2.28 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 63798 W: 15548 L: 15592 D: 32658
PENTA  [103, 7659, 16422, 7609, 106]