FuryBench Testing Framework

home toIntegralPlentyChessObsidianCaissaQuanticadeSerendipitySpaghetSchoenemannClarityIlluminaPawnocchioVineAnura
Finished
Quanticade DarkNeutrino
net58
net58
diffN=5000
ELO    5.60 +- 4.67 (95%)
LLR    1.78 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 12032 W: 4080 L: 3886 D: 4066
PENTA  [504, 1253, 2349, 1365, 545]
Clarity Vast
tb-filtering
Trying it again with TBs, hopefully I can get some workers Issues to be fixed with clarity & fastchess (no SyzygyProbeLimit and bestmove doesnt match last pv)
diff8.0+0.08
ELO    -2.26 +- 2.51 (95%)
LLR    -2.27 (-2.25, 2.89) [-3.00, 1.00]
GAMES  N: 21546 W: 4874 L: 5014 D: 11658
PENTA  [201, 2459, 5541, 2423, 149]
Integral Fury
ti_tweaks
smp diff20.0+0.20
ELO    12.31 +- 5.43 (95%)
LLR    2.91 (-2.25, 2.89) [0.00, 4.00]
GAMES  N: 3868 W: 1029 L: 892 D: 1947
PENTA  [4, 395, 998, 534, 3]
Caissa Witek
eval-84-144B
Optimize StaticExchangeEvaluation Measured bench speedup: +0.233% No functional change.
diff10.0+0.10
ELO    1.35 +- 1.06 (95%)
LLR    2.97 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 110222 W: 26151 L: 25722 D: 58349
PENTA  [337, 13024, 28013, 13347, 390]
Caissa Witek
eval-84-144B
Optimize StaticExchangeEvaluation Measured bench speedup: +0.233% No functional change.
diff10.0+0.10
ELO    8.26 +- 3.10 (95%)
LLR    2.95 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 10860 W: 2946 L: 2688 D: 5226
PENTA  [1, 1087, 2998, 1341, 3]
Illumina Mergener
pre-v4-tune
Pre-release tune
diff40.0+0.40
TUNE   18 parameters
ITER   3,342 / 25,000
GAMES  53,480 / 400,000
Integral Fury
ti_tweaks
diff40.0+0.40
ELO    5.94 +- 2.98 (95%)
LLR    2.90 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 13274 W: 3415 L: 3188 D: 6671
PENTA  [16, 1507, 3363, 1736, 15]
Caissa Witek
see_speedup
Optimize StaticExchangeEvaluation Measured bench speedup: +0.233% No functional change.
diff4.0+0.04
ELO    0.37 +- 1.12 (95%)
LLR    2.96 (-2.94, 2.94) [-2.00, 0.00]
GAMES  N: 105178 W: 25923 L: 25810 D: 53445
PENTA  [735, 11966, 27065, 12097, 726]
Integral Fury
main
Save draw score to correction history if there's an upcoming repetition (#241)
time odds diff10.0+0.10
ELO    56.35 +- 8.81 (95%)
LLR    2.93 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 1474 W: 482 L: 245 D: 747
PENTA  [1, 75, 359, 290, 12]
Integral Fury
ti_tweaks
diffN=25000
ELO    39.42 +- 6.22 (95%)
GAMES  N: 5116/5000 W: 1840 L: 1262 D: 2014
PENTA  [71, 439, 1072, 793, 183]
Integral Fury
ti_tweaks
diff10.0+0.10
ELO    1.57 +- 6.74 (95%)
LLR    0.10 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 2428 W: 620 L: 609 D: 1199
PENTA  [5, 260, 676, 265, 8]
Integral Fury
tile_threat_accum
diff4.0+0.04
ELO    -7.92 +- 4.27 (95%)
LLR    -2.31 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 6668 W: 1618 L: 1770 D: 3280
PENTA  [50, 767, 1836, 647, 34]
Integral Fury
ti_tweaks
diff10.0+0.10
ELO    -8.68 +- 4.59 (95%)
LLR    -2.25 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 6162 W: 1519 L: 1673 D: 2970
PENTA  [40, 792, 1559, 662, 28]
Integral Fury
tile_threat_accum
diff4.0+0.04
ELO    -9.99 +- 4.77 (95%)
LLR    -2.32 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 5460 W: 1273 L: 1430 D: 2757
PENTA  [40, 668, 1456, 541, 25]
Integral Fury
tile_threat_accum
diff10.0+0.10
ELO    -11.25 +- 4.90 (95%)
LLR    -2.26 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 4388 W: 1009 L: 1151 D: 2228
PENTA  [13, 529, 1243, 405, 4]