FuryBench Testing Framework

home toIntegralPlentyChessObsidianCaissaQuanticadeSerendipitySpaghetSchoenemannClarityIlluminaPawnocchioVineAnura
Finished
Caissa Witek
se-beta-half
diff10.0+0.10
ELO    -4.75 +- 3.14 (95%)
LLR    -2.13 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 12666 W: 2865 L: 3038 D: 6763
PENTA  [49, 1606, 3184, 1457, 37]
Caissa Witek
threats-corr
diff10.0+0.10
ELO    -1.03 +- 1.43 (95%)
LLR    -2.97 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 59738 W: 13954 L: 14131 D: 31653
PENTA  [208, 7206, 15180, 7105, 170]
Caissa Witek
remove-counter-move
diff10.0+0.10
ELO    -2.40 +- 1.58 (95%)
LLR    -2.95 (-2.94, 2.94) [-2.00, 0.00]
GAMES  N: 48410 W: 11183 L: 11517 D: 25710
PENTA  [148, 5948, 12322, 5664, 123]
Caissa Witek
eval-83-215B
diff10.0+0.10
ELO    -1.84 +- 1.78 (95%)
LLR    -2.97 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 39266 W: 9100 L: 9308 D: 20858
PENTA  [120, 4852, 9914, 4610, 137]
Caissa Witek
thread-voting
smp diff5.0+0.05
ELO    4.89 +- 2.83 (95%)
LLR    2.95 (-2.94, 2.94) [0.00, 3.00]
GAMES  N: 14216 W: 3387 L: 3187 D: 7642
PENTA  [17, 1578, 3722, 1770, 21]
Caissa Witek
aspiration-stability-shrink
diff10.0+0.10
ELO    -0.09 +- 0.95 (95%)
LLR    -2.66 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 136350 W: 32148 L: 32184 D: 72018
PENTA  [466, 16386, 34502, 16360, 461]
Caissa Witek
lmr_tuned
diff10.0+0.10
ELO    -0.15 +- 1.43 (95%)
LLR    -1.90 (-2.94, 2.94) [-0.50, 2.50]
GAMES  N: 58882 W: 13550 L: 13576 D: 31756
PENTA  [148, 7085, 15002, 7057, 149]
Illumina Mergener
cache-friendliness
crash diff8.0+0.08
ELO    1.12 +- 2.38 (95%)
LLR    -0.11 (-2.25, 2.89) [0.00, 5.00]
GAMES  N: 18600 W: 4051 L: 3991 D: 10558
PENTA  [75, 1758, 5592, 1782, 93]
Caissa Witek
lmr_tune
smp diff40.0+0.40
TUNE   23 parameters
ITER   7,098 / 10,000
GAMES  113,580 / 160,000
Quanticade DarkNeutrino
[Stockfish] dev
diffN=5000
ELO    -151.61 +- 8.51 (95%)
GAMES  N: 4464/40000 W: 672 L: 2505 D: 1287
PENTA  [619, 828, 588, 161, 36]
Quanticade DarkNeutrino
[Stockfish] dev
diffN=5000
ELO    0.00 +- 0.00 (95%)
GAMES  N: 0/40000 W: 0 L: 0 D: 0
PENTA  [0, 0, 0, 0, 0]
Quanticade DarkNeutrino
[Stockfish] dev
diffN=5000
ELO    -17.58 +- 6.16 (95%)
GAMES  N: 6664/40000 W: 2085 L: 2422 D: 2157
PENTA  [300, 855, 1291, 654, 232]
Illumina Mergener
unbloating
diff8.0+0.08
ELO    3.10 +- 2.48 (95%)
LLR    2.92 (-2.25, 2.89) [0.00, 5.00]
GAMES  N: 19922 W: 4475 L: 4297 D: 11150
PENTA  [103, 2097, 5414, 2213, 134]
Illumina Mergener
smaller-tt-entries
diff8.0+0.08
ELO    2.61 +- 2.12 (95%)
LLR    2.91 (-2.25, 2.89) [0.00, 5.00]
GAMES  N: 31510 W: 7097 L: 6860 D: 17553
PENTA  [233, 3713, 7669, 3864, 276]
Illumina Mergener
link-time-optimization
diff8.0+0.08
ELO    -3.03 +- 4.42 (95%)
LLR    -2.26 (-2.25, 2.89) [0.00, 5.00]
GAMES  N: 6646 W: 1423 L: 1481 D: 3742
PENTA  [44, 785, 1722, 729, 43]