FuryBench Testing Framework

home toIntegralPlentyChessObsidianCaissaQuanticadeSerendipitySpaghetSchoenemannClarityIlluminaPawnocchioVineAnura
Finished
Integral Fury
lmp_hist
diff10.0+0.10
ELO    -1.17 +- 1.98 (95%)
LLR    -2.25 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 30656 W: 7612 L: 7715 D: 15329
PENTA  [81, 3679, 7913, 3572, 83]
Integral Fury
aggressive_policy_with_ti
diff10.0+0.10
ELO    -9.68 +- 4.79 (95%)
LLR    -2.25 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 5492 W: 1304 L: 1457 D: 2731
PENTA  [29, 726, 1372, 607, 12]
Integral Fury
lmp_hist
diff10.0+0.10
ELO    -0.96 +- 1.97 (95%)
LLR    -2.03 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 31458 W: 7840 L: 7927 D: 15691
PENTA  [96, 3802, 8015, 3725, 91]
Integral Fury
qs_see_catchup
diff10.0+0.10
ELO    -2.49 +- 2.57 (95%)
LLR    -2.30 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 17982 W: 4399 L: 4528 D: 9055
PENTA  [47, 2179, 4663, 2060, 42]
Caissa Witek
avxvnni_no_bmi2
AVX-VNNI support
diff5.0+0.05
ELO    3.86 +- 2.15 (95%)
LLR    2.95 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 28568 W: 7166 L: 6849 D: 14553
PENTA  [148, 3252, 7222, 3459, 203]
Integral Fury
qs_see_catchup
diff10.0+0.10
ELO    -21.78 +- 6.74 (95%)
LLR    -2.34 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 2556 W: 568 L: 728 D: 1260
PENTA  [8, 379, 659, 229, 3]
Integral Fury
lmr_laterality
diff10.0+0.10
ELO    -3.03 +- 3.90 (95%)
LLR    -1.20 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 8154 W: 1956 L: 2027 D: 4171
PENTA  [18, 1051, 2012, 976, 20]
Integral Fury
lmr_laterality
diff10.0+0.10
ELO    -1.19 +- 3.19 (95%)
LLR    -0.86 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 11424 W: 2817 L: 2856 D: 5751
PENTA  [32, 1330, 3019, 1307, 24]
Illumina Mergener
pre-v4-tune
Tuning
diff40.0+0.40
ELO    3.15 +- 2.52 (95%)
LLR    2.89 (-2.25, 2.89) [0.00, 5.00]
GAMES  N: 18394 W: 3865 L: 3698 D: 10831
PENTA  [36, 2074, 4817, 2227, 43]
Quanticade DarkNeutrino
net58
net58
diffN=5000
ELO    5.60 +- 4.67 (95%)
LLR    1.78 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 12032 W: 4080 L: 3886 D: 4066
PENTA  [504, 1253, 2349, 1365, 545]
Clarity Vast
tb-filtering
Trying it again with TBs, hopefully I can get some workers Issues to be fixed with clarity & fastchess (no SyzygyProbeLimit and bestmove doesnt match last pv)
diff8.0+0.08
ELO    -2.26 +- 2.51 (95%)
LLR    -2.27 (-2.25, 2.89) [-3.00, 1.00]
GAMES  N: 21546 W: 4874 L: 5014 D: 11658
PENTA  [201, 2459, 5541, 2423, 149]
Integral Fury
ti_tweaks
smp diff20.0+0.20
ELO    12.31 +- 5.43 (95%)
LLR    2.91 (-2.25, 2.89) [0.00, 4.00]
GAMES  N: 3868 W: 1029 L: 892 D: 1947
PENTA  [4, 395, 998, 534, 3]
Caissa Witek
eval-84-144B
Optimize StaticExchangeEvaluation Measured bench speedup: +0.233% No functional change.
diff10.0+0.10
ELO    1.35 +- 1.06 (95%)
LLR    2.97 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 110222 W: 26151 L: 25722 D: 58349
PENTA  [337, 13024, 28013, 13347, 390]
Caissa Witek
eval-84-144B
Optimize StaticExchangeEvaluation Measured bench speedup: +0.233% No functional change.
diff10.0+0.10
ELO    8.26 +- 3.10 (95%)
LLR    2.95 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 10860 W: 2946 L: 2688 D: 5226
PENTA  [1, 1087, 2998, 1341, 3]
Illumina Mergener
pre-v4-tune
Pre-release tune
diff40.0+0.40
TUNE   18 parameters
ITER   3,342 / 25,000
GAMES  53,480 / 400,000