FuryBench Testing Framework

home toIntegralPlentyChessObsidianCaissaQuanticadeSerendipitySpaghetSchoenemannClarityIlluminaPawnocchioVineAnura
Finished
Quanticade DarkNeutrino
fix-move-loop-pruning
diff10.0+0.10
ELO    0.66 +- 1.77 (95%)
LLR    2.95 (-2.94, 2.94) [-3.00, 1.00]
GAMES  N: 38830 W: 9158 L: 9084 D: 20588
PENTA  [105, 4620, 9899, 4678, 113]
Caissa Witek
check_value
crash diff10.0+0.10
ELO    1.26 +- 1.42 (95%)
LLR    1.46 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 61834 W: 14772 L: 14548 D: 32514
PENTA  [215, 7349, 15584, 7535, 234]
Quanticade DarkNeutrino
search-legal-before-pruning
diff10.0+0.10
ELO    0.01 +- 1.18 (95%)
LLR    2.95 (-2.94, 2.94) [-3.00, 1.00]
GAMES  N: 86954 W: 20283 L: 20280 D: 46391
PENTA  [265, 10356, 22206, 10411, 239]
Quanticade DarkNeutrino
search-legal-before-pruning
crash diff10.0+0.10
ELO    -30.67 +- 10.39 (95%)
LLR    -2.25 (-2.25, 2.89) [-3.00, 1.00]
GAMES  N: 1238 W: 233 L: 342 D: 663
PENTA  [8, 211, 285, 112, 3]
PlentyChess Yoshie2000
fix-stack-size
diff8.0+0.08
ELO    -1.74 +- 2.15 (95%)
LLR    -2.26 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 22006 W: 5264 L: 5374 D: 11368
PENTA  [32, 2350, 6340, 2258, 23]
PlentyChess Yoshie2000
spsa
diff80.0+0.80
TUNE   131 parameters
ITER   7,500 / 7,500
GAMES  120,000 / 120,000
Quanticade DarkNeutrino
only-legal-moves-qs
diff10.0+0.10
ELO    1.79 +- 2.49 (95%)
LLR    2.90 (-2.25, 2.89) [-3.00, 1.00]
GAMES  N: 19404 W: 4558 L: 4458 D: 10388
PENTA  [54, 2257, 4973, 2371, 47]
PlentyChess Yoshie2000
i8weights-threatonly-wideload-3
diff2.0+0.02
ELO    -0.02 +- 2.66 (95%)
LLR    -0.49 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 18408 W: 4677 L: 4678 D: 9053
PENTA  [136, 2023, 4900, 1996, 149]
Quanticade DarkNeutrino
separate-legal-check
diff10.0+0.10
ELO    0.82 +- 1.81 (95%)
LLR    2.96 (-2.25, 2.89) [-3.00, 1.00]
GAMES  N: 32896 W: 7726 L: 7648 D: 17522
PENTA  [69, 3479, 9290, 3525, 85]
Quanticade DarkNeutrino
spsa-test
smp diff40.0+0.40
TUNE   112 parameters
ITER   195 / 6,250
GAMES  3,132 / 100,000
Quanticade DarkNeutrino
spsa-test
smp diff40.0+0.40
TUNE   112 parameters
ITER   49 / 6,250
GAMES  794 / 100,000
Quanticade DarkNeutrino
master
crash diff10.0+0.10
ELO    65.83 +- 1.86 (95%)
GAMES  N: 40016/40000 W: 14040 L: 6548 D: 19428
PENTA  [131, 2172, 8427, 8630, 648]
Quanticade DarkNeutrino
master
diff60.0+0.60
ELO    0.51 +- 1.40 (95%)
GAMES  N: 50000/50000 W: 11168 L: 11094 D: 27738
PENTA  [25, 5110, 14657, 5182, 26]
Vine SwedishChef
output_buckets
diffN=20000
ELO    -8.98 +- 7.24 (95%)
LLR    -2.35 (-2.25, 2.89) [0.00, 5.00]
GAMES  N: 3288 W: 770 L: 855 D: 1663
PENTA  [57, 437, 729, 376, 45]
PlentyChess Yoshie2000
[Stockfish] ob_16
diff8.0+0.08
ELO    -18.70 +- 11.40 (95%)
GAMES  N: 1004/1000 W: 233 L: 287 D: 484
PENTA  [5, 144, 263, 80, 10]