FuryBench Testing Framework

home toIntegralPlentyChessObsidianCaissaQuanticadeSerendipitySpaghetSchoenemannClarityIlluminaPawnocchioVineAnura
Finished
Quanticade Anematode
prefetch-better
take 2
diff4.0+0.04
ELO    10.21 +- 4.43 (95%)
LLR    2.91 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 6570 W: 1742 L: 1549 D: 3279
PENTA  [38, 655, 1717, 826, 49]
Illumina Mergener
better-improving-condition
Better improving condition
diff8.0+0.08
ELO    8.06 +- 4.87 (95%)
LLR    2.90 (-2.25, 2.89) [0.00, 5.00]
GAMES  N: 5562 W: 1263 L: 1134 D: 3165
PENTA  [26, 624, 1350, 757, 24]
Quanticade DarkNeutrino
net59
Fixed nodes test to even check
diffN=5000
ELO    2.56 +- 2.03 (95%)
LLR    3.03 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 63902 W: 21698 L: 21227 D: 20977
PENTA  [2719, 6809, 12565, 6998, 2860]
Quanticade Anematode
reduce-memset
blah
diff4.0+0.04
ELO    8.46 +- 3.92 (95%)
LLR    2.99 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 8220 W: 2125 L: 1925 D: 4170
PENTA  [40, 855, 2129, 1037, 49]
Quanticade Anematode
pext-attacks
pext attacks
diff4.0+0.04
ELO    9.97 +- 4.36 (95%)
LLR    2.98 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 7040 W: 1874 L: 1672 D: 3494
PENTA  [31, 769, 1743, 921, 56]
Caissa Witek
singular-exact-margin
crash diff10.0+0.10
ELO    1.48 +- 1.13 (95%)
LLR    2.96 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 95014 W: 22588 L: 22184 D: 50242
PENTA  [304, 11096, 24283, 11540, 284]
Integral Fury
nnue_threat_inputs
Switch default network
diff40.0+0.40
ELO    24.43 +- 7.77 (95%)
LLR    2.89 (-2.25, 2.89) [0.00, 4.00]
GAMES  N: 1866 W: 527 L: 396 D: 943
PENTA  [1, 162, 477, 291, 2]
Integral Fury
vaporeon
diff4.0+0.04
ELO    3.27 +- 2.10 (95%)
LLR    2.90 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 26660 W: 6831 L: 6580 D: 13249
PENTA  [131, 2721, 7377, 2968, 133]
Integral Fury
ti-768-chef
diff40.0+0.40
ELO    17.35 +- 6.50 (95%)
LLR    2.91 (-2.25, 2.89) [0.00, 4.00]
GAMES  N: 2666 W: 717 L: 584 D: 1365
PENTA  [3, 249, 696, 382, 3]
Integral Fury
ti-768-chef
diff10.0+0.10
ELO    5.70 +- 3.58 (95%)
LLR    2.89 (-2.25, 2.89) [0.00, 4.00]
GAMES  N: 9700 W: 2555 L: 2396 D: 4749
PENTA  [31, 1089, 2458, 1234, 38]
Integral Fury
ti-768-chef
diffN=20000
ELO    10.15 +- 5.53 (95%)
LLR    2.94 (-2.25, 2.89) [0.00, 4.00]
GAMES  N: 6714 W: 2129 L: 1933 D: 2652
PENTA  [158, 729, 1417, 865, 188]
Quanticade DarkNeutrino
lmp-table
Source: Move LMP formula into a lookup table
diff4.0+0.04
ELO    3.13 +- 2.17 (95%)
LLR    2.92 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 24858 W: 6139 L: 5915 D: 12804
PENTA  [75, 2693, 6711, 2833, 117]
Integral Fury
ti-768-rfs
diff10.0+0.10
ELO    1.97 +- 1.50 (95%)
LLR    2.90 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 54256 W: 13660 L: 13353 D: 27243
PENTA  [156, 6347, 13836, 6612, 177]
Quanticade DarkNeutrino
master
Test against latest release STC
diff10.0+0.10
ELO    71.22 +- 3.66 (95%)
GAMES  N: 10022/10000 W: 3619 L: 1593 D: 4810
PENTA  [10, 500, 2147, 2162, 192]
Integral Fury
ti-768-vf-1
diff10.0+0.10
ELO    2.87 +- 1.95 (95%)
LLR    2.91 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 32856 W: 8414 L: 8143 D: 16299
PENTA  [113, 3824, 8281, 4099, 111]
Integral Fury
perf-sweep
death by a thousand papercuts
diff4.0+0.04
ELO    4.21 +- 2.45 (95%)
LLR    2.90 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 19712 W: 5144 L: 4905 D: 9663
PENTA  [101, 1971, 5487, 2182, 115]
Integral Fury
ti_tweaks
diff40.0+0.40
ELO    95.12 +- 3.14 (95%)
GAMES  N: 10010/10000 W: 3899 L: 1225 D: 4886
PENTA  [4, 238, 1883, 2840, 40]
Integral Fury
ti_tweaks
diff40.0+0.40
ELO    16.91 +- 5.11 (95%)
LLR    2.90 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 4256 W: 1159 L: 952 D: 2145
PENTA  [6, 394, 1116, 611, 1]
Integral Fury
ti-vf-768
diff10.0+0.10
ELO    15.63 +- 5.02 (95%)
LLR    2.92 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 4850 W: 1376 L: 1158 D: 2316
PENTA  [13, 470, 1256, 658, 28]
Integral Fury
ti-768-vf
diffN=20000
ELO    17.64 +- 8.18 (95%)
LLR    3.07 (-2.25, 2.89) [0.00, 5.00]
GAMES  N: 3134 W: 1039 L: 880 D: 1215
PENTA  [70, 318, 664, 413, 102]
Clarity Vast
bestmove
Get best move from PV table I expect null moves, which I'll fix later (hopefully later today)
crash diff8.0+0.08
ELO    4.35 +- 3.68 (95%)
LLR    2.95 (-2.25, 2.89) [-3.00, 1.00]
GAMES  N: 9754 W: 2332 L: 2210 D: 5212
PENTA  [55, 1104, 2444, 1212, 62]
Caissa Witek
fix-bmi2
Fix pext/pdep and MulHi64 falling back to software on non-Windows builds Also, with pext working, restore -DUSE_BMI2 in the makefile native probe. No functional change.
diff5.0+0.05
ELO    3.01 +- 1.84 (95%)
LLR    2.95 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 37274 W: 9297 L: 8974 D: 19003
PENTA  [203, 4093, 9721, 4418, 202]
Caissa Witek
avxvnni_no_bmi2
AVX-VNNI support
diff5.0+0.05
ELO    3.86 +- 2.15 (95%)
LLR    2.95 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 28568 W: 7166 L: 6849 D: 14553
PENTA  [148, 3252, 7222, 3459, 203]
Illumina Mergener
pre-v4-tune
Tuning
diff40.0+0.40
ELO    3.15 +- 2.52 (95%)
LLR    2.89 (-2.25, 2.89) [0.00, 5.00]
GAMES  N: 18394 W: 3865 L: 3698 D: 10831
PENTA  [36, 2074, 4817, 2227, 43]
Integral Fury
ti_tweaks
smp diff20.0+0.20
ELO    12.31 +- 5.43 (95%)
LLR    2.91 (-2.25, 2.89) [0.00, 4.00]
GAMES  N: 3868 W: 1029 L: 892 D: 1947
PENTA  [4, 395, 998, 534, 3]