FuryBench Testing Framework

home toIntegralPlentyChessObsidianCaissaQuanticadeSerendipitySpaghetSchoenemannClarityIlluminaPawnocchioVineAnura
Finished
Quanticade DarkNeutrino
master
Progtest LTC
diff60.0+0.60
ELO    69.54 +- 5.16 (95%)
GAMES  N: 4334/10000 W: 1500 L: 644 D: 2190
PENTA  [1, 198, 947, 986, 35]
Quanticade DarkNeutrino
master
Test against latest release STC
diff10.0+0.10
ELO    71.22 +- 3.66 (95%)
GAMES  N: 10022/10000 W: 3619 L: 1593 D: 4810
PENTA  [10, 500, 2147, 2162, 192]
Integral Fury
ti-768-vf-1
diff10.0+0.10
ELO    2.87 +- 1.95 (95%)
LLR    2.91 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 32856 W: 8414 L: 8143 D: 16299
PENTA  [113, 3824, 8281, 4099, 111]
Integral Fury
perf-sweep
death by a thousand papercuts
diff4.0+0.04
ELO    4.21 +- 2.45 (95%)
LLR    2.90 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 19712 W: 5144 L: 4905 D: 9663
PENTA  [101, 1971, 5487, 2182, 115]
Integral Fury
ti_tweaks
diff40.0+0.40
ELO    95.12 +- 3.14 (95%)
GAMES  N: 10010/10000 W: 3899 L: 1225 D: 4886
PENTA  [4, 238, 1883, 2840, 40]
Integral Fury
[Obsidian] main
diff40.0+0.40
ELO    -16.86 +- 5.01 (95%)
GAMES  N: 4868/10000 W: 1131 L: 1367 D: 2370
PENTA  [15, 713, 1207, 491, 8]
Integral Fury
use_updated_se_history_score
diff10.0+0.10
ELO    -1.06 +- 2.02 (95%)
LLR    -2.02 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 29090 W: 7129 L: 7218 D: 14743
PENTA  [72, 3498, 7481, 3435, 59]
Caissa Witek
eval-85-204B
Fix pext/pdep and MulHi64 falling back to software on non-Windows builds Also, with pext working, restore -DUSE_BMI2 in the makefile native probe. No functional change. Elo | 3.01 +- 1.84 (95%) SPRT | 5.0+0.05s Threads=1 Hash=8MB LLR | 2.95 (-2.94, 2.94) [0.00, 2.00] Games | N: 37274 W: 9297 L: 8974 D: 19003 Penta | [203, 4093, 9721, 4418, 202]
diff10.0+0.10
ELO    0.18 +- 0.67 (95%)
LLR    -2.96 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 276130 W: 64945 L: 64800 D: 146385
PENTA  [910, 33070, 69891, 33353, 841]
Clarity Vast
bestmove
Take 2, trying to fix stale best moves
crash diff8.0+0.08
ELO    -0.29 +- 2.21 (95%)
LLR    0.41 (-2.25, 2.89) [-3.00, 1.00]
GAMES  N: 26674 W: 6075 L: 6097 D: 14502
PENTA  [143, 3157, 6775, 3103, 159]
Integral Fury
ti_tweaks
diff40.0+0.40
ELO    16.91 +- 5.11 (95%)
LLR    2.90 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 4256 W: 1159 L: 952 D: 2145
PENTA  [6, 394, 1116, 611, 1]
Integral Fury
ti-vf-768
diff10.0+0.10
ELO    15.63 +- 5.02 (95%)
LLR    2.92 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 4850 W: 1376 L: 1158 D: 2316
PENTA  [13, 470, 1256, 658, 28]
Integral Fury
ti-768-vf
diff10.0+0.10
ELO    9.92 +- 7.87 (95%)
LLR    0.79 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 2278 W: 609 L: 544 D: 1125
PENTA  [8, 272, 524, 317, 18]
Integral Fury
ti-768-vf
diffN=20000
ELO    17.64 +- 8.18 (95%)
LLR    3.07 (-2.25, 2.89) [0.00, 5.00]
GAMES  N: 3134 W: 1039 L: 880 D: 1215
PENTA  [70, 318, 664, 413, 102]
Quanticade DarkNeutrino
tuning
Source: Tuned 3130 iters
smp diff20.0+0.20
ELO    1.28 +- 3.08 (95%)
LLR    0.33 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 10594 W: 2439 L: 2400 D: 5755
PENTA  [0, 1125, 3009, 1162, 1]
Caissa Witek
corrhist_cycle_draw
diff40.0+0.40
ELO    1.03 +- 1.54 (95%)
LLR    0.71 (-2.94, 2.94) [0.00, 3.00]
GAMES  N: 48006 W: 11119 L: 10976 D: 25911
PENTA  [52, 5596, 12559, 5749, 47]