FuryBench Testing Framework

home toIntegralPlentyChessObsidianCaissaQuanticadeSerendipitySpaghetSchoenemannClarityIlluminaPawnocchioVineAnura
Finished
Caissa Witek
avxvnni_no_bmi2
AVX-VNNI support
diff5.0+0.05
ELO    3.86 +- 2.15 (95%)
LLR    2.95 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 28568 W: 7166 L: 6849 D: 14553
PENTA  [148, 3252, 7222, 3459, 203]
Integral Fury
qs_see_catchup
diff10.0+0.10
ELO    -21.78 +- 6.74 (95%)
LLR    -2.34 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 2556 W: 568 L: 728 D: 1260
PENTA  [8, 379, 659, 229, 3]
Integral Fury
lmr_laterality
diff10.0+0.10
ELO    -3.03 +- 3.90 (95%)
LLR    -1.20 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 8154 W: 1956 L: 2027 D: 4171
PENTA  [18, 1051, 2012, 976, 20]
Integral Fury
lmr_laterality
diff10.0+0.10
ELO    -1.19 +- 3.19 (95%)
LLR    -0.86 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 11424 W: 2817 L: 2856 D: 5751
PENTA  [32, 1330, 3019, 1307, 24]
Illumina Mergener
pre-v4-tune
Tuning
diff40.0+0.40
ELO    3.15 +- 2.52 (95%)
LLR    2.89 (-2.25, 2.89) [0.00, 5.00]
GAMES  N: 18394 W: 3865 L: 3698 D: 10831
PENTA  [36, 2074, 4817, 2227, 43]
Quanticade DarkNeutrino
net58
net58
diffN=5000
ELO    5.60 +- 4.67 (95%)
LLR    1.78 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 12032 W: 4080 L: 3886 D: 4066
PENTA  [504, 1253, 2349, 1365, 545]
Clarity Vast
tb-filtering
Trying it again with TBs, hopefully I can get some workers Issues to be fixed with clarity & fastchess (no SyzygyProbeLimit and bestmove doesnt match last pv)
diff8.0+0.08
ELO    -2.26 +- 2.51 (95%)
LLR    -2.27 (-2.25, 2.89) [-3.00, 1.00]
GAMES  N: 21546 W: 4874 L: 5014 D: 11658
PENTA  [201, 2459, 5541, 2423, 149]
Integral Fury
ti_tweaks
smp diff20.0+0.20
ELO    12.31 +- 5.43 (95%)
LLR    2.91 (-2.25, 2.89) [0.00, 4.00]
GAMES  N: 3868 W: 1029 L: 892 D: 1947
PENTA  [4, 395, 998, 534, 3]
Caissa Witek
eval-84-144B
Optimize StaticExchangeEvaluation Measured bench speedup: +0.233% No functional change.
diff10.0+0.10
ELO    1.35 +- 1.06 (95%)
LLR    2.97 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 110222 W: 26151 L: 25722 D: 58349
PENTA  [337, 13024, 28013, 13347, 390]
Caissa Witek
eval-84-144B
Optimize StaticExchangeEvaluation Measured bench speedup: +0.233% No functional change.
diff10.0+0.10
ELO    8.26 +- 3.10 (95%)
LLR    2.95 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 10860 W: 2946 L: 2688 D: 5226
PENTA  [1, 1087, 2998, 1341, 3]
Illumina Mergener
pre-v4-tune
Pre-release tune
diff40.0+0.40
TUNE   18 parameters
ITER   3,342 / 25,000
GAMES  53,480 / 400,000
Integral Fury
ti_tweaks
diff40.0+0.40
ELO    5.94 +- 2.98 (95%)
LLR    2.90 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 13274 W: 3415 L: 3188 D: 6671
PENTA  [16, 1507, 3363, 1736, 15]
Caissa Witek
see_speedup
Optimize StaticExchangeEvaluation Measured bench speedup: +0.233% No functional change.
diff4.0+0.04
ELO    0.37 +- 1.12 (95%)
LLR    2.96 (-2.94, 2.94) [-2.00, 0.00]
GAMES  N: 105178 W: 25923 L: 25810 D: 53445
PENTA  [735, 11966, 27065, 12097, 726]
Integral Fury
main
Save draw score to correction history if there's an upcoming repetition (#241)
time odds diff10.0+0.10
ELO    56.35 +- 8.81 (95%)
LLR    2.93 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 1474 W: 482 L: 245 D: 747
PENTA  [1, 75, 359, 290, 12]
Integral Fury
ti_tweaks
diffN=25000
ELO    39.42 +- 6.22 (95%)
GAMES  N: 5116/5000 W: 1840 L: 1262 D: 2014
PENTA  [71, 439, 1072, 793, 183]