FuryBench Testing Framework

home toIntegralPlentyChessObsidianCaissaQuanticadeSerendipitySpaghetSchoenemannClarityIlluminaPawnocchioVineAnura
Finished
Integral Fury
ti-768-chef
diffN=20000
ELO    10.15 +- 5.53 (95%)
LLR    2.94 (-2.25, 2.89) [0.00, 4.00]
GAMES  N: 6714 W: 2129 L: 1933 D: 2652
PENTA  [158, 729, 1417, 865, 188]
Quanticade DarkNeutrino
lmp-table
Source: Move LMP formula into a lookup table
diff4.0+0.04
ELO    3.13 +- 2.17 (95%)
LLR    2.92 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 24858 W: 6139 L: 5915 D: 12804
PENTA  [75, 2693, 6711, 2833, 117]
Integral Fury
ti-768-rfs
diff10.0+0.10
ELO    1.97 +- 1.50 (95%)
LLR    2.90 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 54256 W: 13660 L: 13353 D: 27243
PENTA  [156, 6347, 13836, 6612, 177]
Quanticade DarkNeutrino
master
Test against latest release STC
diff10.0+0.10
ELO    71.22 +- 3.66 (95%)
GAMES  N: 10022/10000 W: 3619 L: 1593 D: 4810
PENTA  [10, 500, 2147, 2162, 192]
Integral Fury
ti-768-vf-1
diff10.0+0.10
ELO    2.87 +- 1.95 (95%)
LLR    2.91 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 32856 W: 8414 L: 8143 D: 16299
PENTA  [113, 3824, 8281, 4099, 111]
Integral Fury
perf-sweep
death by a thousand papercuts
diff4.0+0.04
ELO    4.21 +- 2.45 (95%)
LLR    2.90 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 19712 W: 5144 L: 4905 D: 9663
PENTA  [101, 1971, 5487, 2182, 115]
Integral Fury
ti_tweaks
diff40.0+0.40
ELO    95.12 +- 3.14 (95%)
GAMES  N: 10010/10000 W: 3899 L: 1225 D: 4886
PENTA  [4, 238, 1883, 2840, 40]
Integral Fury
ti_tweaks
diff40.0+0.40
ELO    16.91 +- 5.11 (95%)
LLR    2.90 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 4256 W: 1159 L: 952 D: 2145
PENTA  [6, 394, 1116, 611, 1]
Integral Fury
ti-vf-768
diff10.0+0.10
ELO    15.63 +- 5.02 (95%)
LLR    2.92 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 4850 W: 1376 L: 1158 D: 2316
PENTA  [13, 470, 1256, 658, 28]
Integral Fury
ti-768-vf
diffN=20000
ELO    17.64 +- 8.18 (95%)
LLR    3.07 (-2.25, 2.89) [0.00, 5.00]
GAMES  N: 3134 W: 1039 L: 880 D: 1215
PENTA  [70, 318, 664, 413, 102]
Clarity Vast
bestmove
Get best move from PV table I expect null moves, which I'll fix later (hopefully later today)
crash diff8.0+0.08
ELO    4.35 +- 3.68 (95%)
LLR    2.95 (-2.25, 2.89) [-3.00, 1.00]
GAMES  N: 9754 W: 2332 L: 2210 D: 5212
PENTA  [55, 1104, 2444, 1212, 62]
Caissa Witek
fix-bmi2
Fix pext/pdep and MulHi64 falling back to software on non-Windows builds Also, with pext working, restore -DUSE_BMI2 in the makefile native probe. No functional change.
diff5.0+0.05
ELO    3.01 +- 1.84 (95%)
LLR    2.95 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 37274 W: 9297 L: 8974 D: 19003
PENTA  [203, 4093, 9721, 4418, 202]
Caissa Witek
avxvnni_no_bmi2
AVX-VNNI support
diff5.0+0.05
ELO    3.86 +- 2.15 (95%)
LLR    2.95 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 28568 W: 7166 L: 6849 D: 14553
PENTA  [148, 3252, 7222, 3459, 203]
Illumina Mergener
pre-v4-tune
Tuning
diff40.0+0.40
ELO    3.15 +- 2.52 (95%)
LLR    2.89 (-2.25, 2.89) [0.00, 5.00]
GAMES  N: 18394 W: 3865 L: 3698 D: 10831
PENTA  [36, 2074, 4817, 2227, 43]
Integral Fury
ti_tweaks
smp diff20.0+0.20
ELO    12.31 +- 5.43 (95%)
LLR    2.91 (-2.25, 2.89) [0.00, 4.00]
GAMES  N: 3868 W: 1029 L: 892 D: 1947
PENTA  [4, 395, 998, 534, 3]
Caissa Witek
eval-84-144B
Optimize StaticExchangeEvaluation Measured bench speedup: +0.233% No functional change.
diff10.0+0.10
ELO    1.35 +- 1.06 (95%)
LLR    2.97 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 110222 W: 26151 L: 25722 D: 58349
PENTA  [337, 13024, 28013, 13347, 390]
Caissa Witek
eval-84-144B
Optimize StaticExchangeEvaluation Measured bench speedup: +0.233% No functional change.
diff10.0+0.10
ELO    8.26 +- 3.10 (95%)
LLR    2.95 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 10860 W: 2946 L: 2688 D: 5226
PENTA  [1, 1087, 2998, 1341, 3]
Integral Fury
ti_tweaks
diff40.0+0.40
ELO    5.94 +- 2.98 (95%)
LLR    2.90 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 13274 W: 3415 L: 3188 D: 6671
PENTA  [16, 1507, 3363, 1736, 15]
Caissa Witek
see_speedup
Optimize StaticExchangeEvaluation Measured bench speedup: +0.233% No functional change.
diff4.0+0.04
ELO    0.37 +- 1.12 (95%)
LLR    2.96 (-2.94, 2.94) [-2.00, 0.00]
GAMES  N: 105178 W: 25923 L: 25810 D: 53445
PENTA  [735, 11966, 27065, 12097, 726]
Integral Fury
main
Save draw score to correction history if there's an upcoming repetition (#241)
time odds diff10.0+0.10
ELO    56.35 +- 8.81 (95%)
LLR    2.93 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 1474 W: 482 L: 245 D: 747
PENTA  [1, 75, 359, 290, 12]
Integral Fury
ti_tweaks
diffN=25000
ELO    39.42 +- 6.22 (95%)
GAMES  N: 5116/5000 W: 1840 L: 1262 D: 2014
PENTA  [71, 439, 1072, 793, 183]
Integral Fury
ti_tweaks
diff10.0+0.10
ELO    8.23 +- 3.51 (95%)
LLR    2.96 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 9376 W: 2469 L: 2247 D: 4660
PENTA  [28, 933, 2556, 1131, 40]
Caissa Witek
makefile-fix
Makefile: Fix net download and INCBIN build race Force HTTP/1.1 with retries (some hosts hit HTTP/2 PROTOCOL_ERROR on the GitHub CDN) and download via a temporary file, so a partial transfer is never mistaken for a complete net. Make Evaluate.o and the per-arch targets depend on the net file, since it's embedded at compile time via INCBIN and could otherwise be read while still downloading under make -j.
diff10.0+0.10
ELO    4.17 +- 10.80 (95%)
GAMES  N: 1000/1000 W: 240 L: 228 D: 532
PENTA  [2, 108, 271, 114, 5]
Clarity Vast
tb-filtering
TB optimal move filtering at root. No elo but looks nice in tournaments :)
crash diff8.0+0.08
ELO    1.62 +- 2.40 (95%)
LLR    2.89 (-2.25, 2.89) [-3.00, 1.00]
GAMES  N: 20766 W: 4783 L: 4686 D: 11297
PENTA  [102, 2214, 5651, 2317, 99]
Caissa Witek
move-overhead-fix
diff10.0+0.10
ELO    0.58 +- 1.60 (95%)
LLR    2.95 (-2.94, 2.94) [-3.00, 0.00]
GAMES  N: 44418 W: 10552 L: 10478 D: 23388
PENTA  [129, 4900, 12073, 4982, 125]