FuryBench Testing Framework

home toIntegralPlentyChessObsidianCaissaQuanticadeSerendipitySpaghetSchoenemannClarityIlluminaPawnocchioVineAnura
Finished
Caissa Witek
root-partial-best-move
diff10.0+0.10
ELO    1.51 +- 1.15 (95%)
LLR    2.95 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 87868 W: 20973 L: 20591 D: 46304
PENTA  [232, 9850, 23386, 10236, 230]
Caissa Witek
root-partial-best-move
diff4.0+0.04
ELO    2.83 +- 1.79 (95%)
LLR    2.95 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 41878 W: 10427 L: 10086 D: 21365
PENTA  [257, 4816, 10506, 5049, 311]
Caissa Witek
speedups
Search: Keep accumulators and PV lines out of NodeInfo NodeInfo shrinks from 6.9 KB to a few hundred bytes, so the search state of nearby plies shares cache lines and pages. Total memory is unchanged. Measured against the previous commit at depth 13: make bmi2 +0.41% [+0.06, +0.76] (accumulators), +0.20% [-0.16, +0.57] (PV line) make bmi2_pgo +0.43% [+0.08, +0.77] (both) Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
diff4.0+0.04
ELO    1.11 +- 0.89 (95%)
LLR    2.95 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 169906 W: 42275 L: 41734 D: 85897
PENTA  [1138, 19897, 42401, 20320, 1197]
PlentyChess Yoshie2000
npv-fds-ext
diff8.0+0.08
ELO    0.91 +- 0.69 (95%)
LLR    2.89 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 243308 W: 59420 L: 58786 D: 125102
PENTA  [334, 28319, 63719, 28943, 339]
Quanticade DarkNeutrino
fix-history-enpas
search.c: Fix capture history indexing on enpassant
diff10.0+0.10
ELO    1.11 +- 2.02 (95%)
LLR    2.97 (-2.94, 2.94) [-3.00, 1.00]
GAMES  N: 27626 W: 6597 L: 6509 D: 14520
PENTA  [62, 3065, 7470, 3155, 61]
Quanticade DarkNeutrino
see-ray-fix
see.c: Fix SEE pinned ray
diff10.0+0.10
ELO    -0.13 +- 0.95 (95%)
LLR    2.94 (-2.94, 2.94) [-3.00, 1.00]
GAMES  N: 121730 W: 28838 L: 28884 D: 64008
PENTA  [223, 13521, 33428, 13465, 228]
Quanticade DarkNeutrino
[Stockfish] master
Adv datagen vs SF 6000 fixed nodes
time odds diffN=5000
ELO    -5.38 +- 0.19 (95%)
GAMES  N: 10000006/10000000 W: 3782460 L: 3937423 D: 2280123
PlentyChess Yoshie2000
refuted-by-probcut
diff40.0+0.40
ELO    1.09 +- 0.89 (95%)
LLR    2.89 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 133196 W: 32346 L: 31928 D: 68922
PENTA  [24, 14692, 36740, 15126, 16]
PlentyChess Yoshie2000
0194
diffN=20000
ELO    4.70 +- 2.77 (95%)
LLR    3.04 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 23066 W: 6703 L: 6391 D: 9972
PENTA  [378, 2690, 5118, 2936, 411]
Integral Fury
factorised-ob
diffN=20000
ELO    1.81 +- 1.35 (95%)
LLR    3.44 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 95164 W: 27140 L: 26645 D: 41379
PENTA  [1523, 11399, 21319, 11742, 1599]
Integral Fury
non_capthist_malus_decay
diff40.0+0.40
ELO    1.95 +- 1.53 (95%)
LLR    2.89 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 44314 W: 10913 L: 10664 D: 22737
PENTA  [11, 4783, 12323, 5026, 14]
PlentyChess Yoshie2000
refuted-by-probcut
diff8.0+0.08
ELO    1.01 +- 0.80 (95%)
LLR    2.91 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 180496 W: 44044 L: 43519 D: 92933
PENTA  [280, 21019, 47108, 21578, 263]
Integral Fury
non_capthist_malus_decay
diff10.0+0.10
ELO    4.39 +- 2.69 (95%)
LLR    2.90 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 15980 W: 4076 L: 3874 D: 8030
PENTA  [20, 1788, 4189, 1956, 37]
PlentyChess Yoshie2000
0193
diffN=20000
ELO    1.89 +- 1.50 (95%)
LLR    2.91 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 73532 W: 20653 L: 20254 D: 32625
PENTA  [972, 8876, 16790, 9037, 1091]
PlentyChess Yoshie2000
0193
diff8.0+0.08
ELO    6.58 +- 3.17 (95%)
LLR    2.89 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 11990 W: 3139 L: 2912 D: 5939
PENTA  [24, 1333, 3070, 1528, 40]
PlentyChess Yoshie2000
0193
diffN=20000
ELO    10.12 +- 2.89 (95%)
GAMES  N: 20014/20000 W: 6045 L: 5462 D: 8507
PENTA  [254, 2209, 4595, 2598, 351]
PlentyChess Yoshie2000
0192
diff8.0+0.08
ELO    5.68 +- 2.91 (95%)
LLR    2.90 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 14076 W: 3602 L: 3372 D: 7102
PENTA  [24, 1578, 3623, 1770, 43]
PlentyChess Yoshie2000
0192
diffN=20000
ELO    10.01 +- 2.08 (95%)
GAMES  N: 40034/40000 W: 11910 L: 10757 D: 17367
PENTA  [557, 4480, 8966, 5281, 733]
Erebus Jshriver
main
Thanks for all the help!
diffN=25000
ELO    -0.10 +- 0.24 (95%)
GAMES  N: 5000004/5000000 W: 1577354 L: 1578746 D: 1843904
PlentyChess Yoshie2000
bnfp-hist
diff8.0+0.08
ELO    2.25 +- 1.64 (95%)
LLR    2.90 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 42930 W: 10612 L: 10334 D: 21984
PENTA  [67, 4943, 11162, 5231, 62]
PlentyChess Yoshie2000
sf-lmr-an-scaling
diff8.0+0.08
ELO    1.73 +- 1.35 (95%)
LLR    2.90 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 63400 W: 15612 L: 15297 D: 32491
PENTA  [95, 7330, 16554, 7607, 114]
Erebus Jshriver
main
diffN=25000
ELO    -0.01 +- 0.54 (95%)
GAMES  N: 1000146/1000000 W: 315716 L: 315734 D: 368696
Quanticade DarkNeutrino
see-min
search.c: see_threshold below 0 always
diff60.0+0.60
ELO    3.67 +- 3.20 (95%)
LLR    2.95 (-2.94, 2.94) [-3.00, 1.00]
GAMES  N: 10212 W: 2429 L: 2321 D: 5462
PENTA  [1, 1097, 2802, 1205, 1]
Quanticade DarkNeutrino
[Stockfish] master
diffN=5000
ELO    26.51 +- 2.51 (95%)
GAMES  N: 40710/40000 W: 15369 L: 12269 D: 13072
PENTA  [1213, 3897, 8044, 4979, 2222]
PlentyChess Yoshie2000
lmr-check-after-factor
diff8.0+0.08
ELO    1.03 +- 0.82 (95%)
LLR    2.91 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 172966 W: 42239 L: 41726 D: 89001
PENTA  [283, 20217, 44972, 20726, 285]