FuryBench Testing Framework

home toIntegralPlentyChessObsidianCaissaQuanticadeSerendipitySpaghetSchoenemannClarityIlluminaPawnocchioVineAnura
Active : 30 Machines / 756 Threads / 425.76 MNPS
Priority 0
PlentyChess Yoshie2000
refuted-by-probcut
diff40.0+0.40
ELO    1.04 +- 2.22 (95%)
LLR    0.41 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 21384 W: 5217 L: 5153 D: 11014
PENTA  [4, 2373, 5876, 2433, 6]
Quanticade DarkNeutrino
[Stockfish] master
Adv datagen vs SF 6000 fixed nodes
time odds diffN=5000
ELO    -5.33 +- 0.24 (95%)
GAMES  N: 6192640/10000000 W: 2343375 L: 2438309 D: 1410956
Caissa Witek
hmc-input
Eval: Half-move counter inputs (net version 16) Net format version 16 adds 12 feature transformer rows after the piece inputs: bucket b = min(hmc / 8, 12) activates row b - 1 in both perspectives, no row below hmc 8. The incremental update compares the bucket at the two ends of the update path; the accumulator cache stays piece-only and the row is added when a node is built from it. `utils upgradeNet` converts a version 15 net with zero rows, which is an exact no-op (bench 5907427, same as master). Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
diff10.0+0.10
ELO    -4.67 +- 4.00 (95%)
LLR    -0.81 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 3274 W: 1075 L: 1119 D: 1080
PENTA  [0, 207, 1267, 163, 0]
Caissa Witek
hmc-input
Eval: Half-move counter inputs (net version 16) Net format version 16 adds 12 feature transformer rows after the piece inputs: bucket b = min(hmc / 8, 12) activates row b - 1 in both perspectives, no row below hmc 8. The incremental update compares the bucket at the two ends of the update path; the accumulator cache stays piece-only and the row is added when a node is built from it. `utils upgradeNet` converts a version 15 net with zero rows, which is an exact no-op (bench 5907427, same as master). Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
diff10.0+0.10
ELO    -6.35 +- 4.44 (95%)
LLR    -1.23 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 5092 W: 1193 L: 1286 D: 2613
PENTA  [0, 597, 1447, 500, 2]
Integral Fury
factorised-ob
diff10.0+0.10
ELO    -2.85 +- 4.11 (95%)
LLR    -1.28 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 7302 W: 1790 L: 1850 D: 3662
PENTA  [24, 907, 1846, 853, 21]
Finished
Integral Fury
factorised-ob
diffN=20000
ELO    1.81 +- 1.35 (95%)
LLR    3.44 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 95164 W: 27140 L: 26645 D: 41379
PENTA  [1523, 11399, 21319, 11742, 1599]
Integral Fury
non_capthist_malus_decay
diff40.0+0.40
ELO    1.95 +- 1.53 (95%)
LLR    2.89 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 44314 W: 10913 L: 10664 D: 22737
PENTA  [11, 4783, 12323, 5026, 14]
PlentyChess Yoshie2000
refuted-by-probcut
diff8.0+0.08
ELO    1.01 +- 0.80 (95%)
LLR    2.91 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 180496 W: 44044 L: 43519 D: 92933
PENTA  [280, 21019, 47108, 21578, 263]
Integral Fury
limit_history_static_eval_updates
diff10.0+0.10
ELO    -0.74 +- 2.37 (95%)
LLR    -1.53 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 20620 W: 4992 L: 5036 D: 10592
PENTA  [42, 2426, 5420, 2378, 44]
PlentyChess Yoshie2000
0193
diff8.0+0.08
ELO    0.18 +- 2.12 (95%)
LLR    -0.48 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 26306 W: 6500 L: 6486 D: 13320
PENTA  [49, 3137, 6773, 3139, 55]
PlentyChess Yoshie2000
0193
diff40.0+0.40
ELO    -2.74 +- 2.93 (95%)
LLR    -1.81 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 12692 W: 3060 L: 3160 D: 6472
PENTA  [1, 1530, 3390, 1418, 7]
Integral Fury
non_capthist_malus_decay
diff10.0+0.10
ELO    4.39 +- 2.69 (95%)
LLR    2.90 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 15980 W: 4076 L: 3874 D: 8030
PENTA  [20, 1788, 4189, 1956, 37]
PlentyChess Yoshie2000
0193
diffN=20000
ELO    1.89 +- 1.50 (95%)
LLR    2.91 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 73532 W: 20653 L: 20254 D: 32625
PENTA  [972, 8876, 16790, 9037, 1091]
Integral Fury
pc_imp_depth
diff10.0+0.10
ELO    -2.12 +- 2.69 (95%)
LLR    -2.26 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 15754 W: 3899 L: 3995 D: 7860
PENTA  [32, 1862, 4183, 1770, 30]
Integral Fury
seval_overestimate_lmr
diff10.0+0.10
ELO    -2.31 +- 4.64 (95%)
LLR    -0.81 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 5274 W: 1317 L: 1352 D: 2605
PENTA  [6, 636, 1391, 595, 9]
Integral Fury
d12_fp
diff10.0+0.10
ELO    0.93 +- 1.64 (95%)
LLR    0.40 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 42762 W: 10629 L: 10514 D: 21619
PENTA  [71, 4935, 11266, 5026, 83]
PlentyChess Yoshie2000
0193
diff8.0+0.08
ELO    6.58 +- 3.17 (95%)
LLR    2.89 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 11990 W: 3139 L: 2912 D: 5939
PENTA  [24, 1333, 3070, 1528, 40]
PlentyChess Yoshie2000
0193
diffN=20000
ELO    10.12 +- 2.89 (95%)
GAMES  N: 20014/20000 W: 6045 L: 5462 D: 8507
PENTA  [254, 2209, 4595, 2598, 351]
PlentyChess Yoshie2000
probcut-hist-update
diff8.0+0.08
ELO    -0.24 +- 1.35 (95%)
LLR    -2.28 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 63798 W: 15548 L: 15592 D: 32658
PENTA  [103, 7659, 16422, 7609, 106]
PlentyChess Yoshie2000
0192
diff40.0+0.40
ELO    -2.99 +- 2.70 (95%)
LLR    -2.27 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 14630 W: 3626 L: 3752 D: 7252
PENTA  [6, 1727, 3974, 1603, 5]