FuryBench Testing Framework

home toIntegralPlentyChessObsidianCaissaQuanticadeSerendipitySpaghetSchoenemannClarityIlluminaPawnocchioVineAnura
Active : 36 Machines / 522 Threads / 243.82 MNPS
Priority 0
PlentyChess Yoshie2000
refuted-by-probcut
diff40.0+0.40
ELO    1.04 +- 0.91 (95%)
LLR    2.44 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 125054 W: 30368 L: 29994 D: 64692
PENTA  [22, 13787, 34529, 14173, 16]
Quanticade DarkNeutrino
see-ray-fix
see.c: Fix SEE pinned ray
diff10.0+0.10
ELO    -0.21 +- 3.32 (95%)
LLR    0.19 (-2.94, 2.94) [-3.00, 1.00]
GAMES  N: 10084 W: 2390 L: 2396 D: 5298
PENTA  [24, 1114, 2770, 1112, 22]
Quanticade DarkNeutrino
[Stockfish] master
Adv datagen vs SF 6000 fixed nodes
time odds diffN=5000
ELO    -5.39 +- 0.20 (95%)
GAMES  N: 8534530/10000000 W: 3228154 L: 3360637 D: 1945739
Integral Fury
corrhist_fmr_buckets
diff10.0+0.10
ELO    -1.56 +- 2.52 (95%)
LLR    -2.05 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 17640 W: 4296 L: 4375 D: 8969
PENTA  [34, 2043, 4733, 1988, 22]
Quanticade DarkNeutrino
16k-history-limit
Switch to 16K history limits
diff10.0+0.10
ELO    -2.14 +- 2.24 (95%)
LLR    -2.53 (-2.94, 2.94) [-3.00, 1.00]
GAMES  N: 23588 W: 5572 L: 5717 D: 12299
PENTA  [46, 2899, 6039, 2774, 36]
Finished
Integral Fury
singular_ext_defer_tt_move
diff10.0+0.10
ELO    -0.67 +- 1.89 (95%)
LLR    -2.30 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 32628 W: 8017 L: 8080 D: 16531
PENTA  [59, 3872, 8543, 3753, 87]
Integral Fury
moar_hist_bonus
diff10.0+0.10
ELO    -0.51 +- 1.75 (95%)
LLR    -2.40 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 38510 W: 9502 L: 9558 D: 19450
PENTA  [68, 4613, 9968, 4519, 87]
PlentyChess Yoshie2000
0194
diff40.0+0.40
ELO    -3.67 +- 2.96 (95%)
LLR    -2.26 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 12316 W: 2976 L: 3106 D: 6234
PENTA  [7, 1466, 3343, 1334, 8]
Integral Fury
singular_ext_defer_tt_move
diff10.0+0.10
ELO    0.00 +- 0.00 (95%)
LLR    0.00 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 0 W: 0 L: 0 D: 0
PENTA  [0, 0, 0, 0, 0]
PlentyChess Yoshie2000
0194
diff8.0+0.08
ELO    -0.88 +- 1.81 (95%)
LLR    -2.26 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 36794 W: 9169 L: 9262 D: 18363
PENTA  [91, 4474, 9376, 4349, 107]
Integral Fury
factorised-ob
diff40.0+0.40
ELO    -0.57 +- 1.77 (95%)
LLR    -2.28 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 34292 W: 8337 L: 8393 D: 17562
PENTA  [25, 3906, 9332, 3866, 17]
Integral Fury
bch_keys
diff10.0+0.10
ELO    -1.40 +- 2.99 (95%)
LLR    -1.40 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 13146 W: 3211 L: 3264 D: 6671
PENTA  [22, 1611, 3357, 1564, 19]
PlentyChess Yoshie2000
0194
diffN=20000
ELO    4.70 +- 2.77 (95%)
LLR    3.04 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 23066 W: 6703 L: 6391 D: 9972
PENTA  [378, 2690, 5118, 2936, 411]
Caissa Witek
hmc-input
Eval: Half-move counter inputs (net version 16) Net format version 16 adds 12 feature transformer rows after the piece inputs: bucket b = min(hmc / 8, 12) activates row b - 1 in both perspectives, no row below hmc 8. The incremental update compares the bucket at the two ends of the update path; the accumulator cache stays piece-only and the row is added when a node is built from it. `utils upgradeNet` converts a version 15 net with zero rows, which is an exact no-op (bench 5907427, same as master). Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
diff10.0+0.10
ELO    -4.21 +- 2.01 (95%)
LLR    -2.95 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 13378 W: 4395 L: 4557 D: 4426
PENTA  [2, 855, 5137, 693, 2]
Caissa Witek
hmc-input
Eval: Half-move counter inputs (net version 16) Net format version 16 adds 12 feature transformer rows after the piece inputs: bucket b = min(hmc / 8, 12) activates row b - 1 in both perspectives, no row below hmc 8. The incremental update compares the bucket at the two ends of the update path; the accumulator cache stays piece-only and the row is added when a node is built from it. `utils upgradeNet` converts a version 15 net with zero rows, which is an exact no-op (bench 5907427, same as master). Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
diff10.0+0.10
ELO    -8.63 +- 3.33 (95%)
LLR    -2.95 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 9180 W: 2127 L: 2355 D: 4698
PENTA  [0, 1122, 2577, 888, 3]
Integral Fury
factorised-ob
diff10.0+0.10
ELO    -1.66 +- 2.49 (95%)
LLR    -2.27 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 19102 W: 4619 L: 4710 D: 9773
PENTA  [57, 2269, 4977, 2204, 44]
Integral Fury
factorised-ob
diffN=20000
ELO    1.81 +- 1.35 (95%)
LLR    3.44 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 95164 W: 27140 L: 26645 D: 41379
PENTA  [1523, 11399, 21319, 11742, 1599]
Integral Fury
non_capthist_malus_decay
diff40.0+0.40
ELO    1.95 +- 1.53 (95%)
LLR    2.89 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 44314 W: 10913 L: 10664 D: 22737
PENTA  [11, 4783, 12323, 5026, 14]
PlentyChess Yoshie2000
refuted-by-probcut
diff8.0+0.08
ELO    1.01 +- 0.80 (95%)
LLR    2.91 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 180496 W: 44044 L: 43519 D: 92933
PENTA  [280, 21019, 47108, 21578, 263]
Integral Fury
limit_history_static_eval_updates
diff10.0+0.10
ELO    -0.74 +- 2.37 (95%)
LLR    -1.53 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 20620 W: 4992 L: 5036 D: 10592
PENTA  [42, 2426, 5420, 2378, 44]