FuryBench Testing Framework

home toIntegralPlentyChessObsidianCaissaQuanticadeSerendipitySpaghetSchoenemannClarityIlluminaPawnocchioVineAnura
Finished
Caissa Witek
hist_update_depth_4
diff10.0+0.10
ELO    -5.15 +- 2.77 (95%)
LLR    -2.95 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 16326 W: 3751 L: 3993 D: 8582
PENTA  [61, 2076, 4142, 1812, 72]
Vine Fury
combined_v28_p8
diff10.0+0.10
ELO    8.61 +- 5.69 (95%)
LLR    2.90 (-2.25, 2.89) [0.00, 5.00]
GAMES  N: 7302 W: 2360 L: 2179 D: 2763
PENTA  [215, 827, 1472, 836, 301]
Quanticade DarkNeutrino
simplify-razoring-check
diff10.0+0.10
ELO    -2.27 +- 2.49 (95%)
LLR    -2.25 (-2.25, 2.89) [-3.00, 1.00]
GAMES  N: 20230 W: 4731 L: 4863 D: 10636
PENTA  [71, 2518, 5067, 2390, 69]
Quanticade DarkNeutrino
nmp-more-reduction
diff10.0+0.10
ELO    1.75 +- 1.35 (95%)
LLR    2.94 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 63448 W: 14851 L: 14532 D: 34065
PENTA  [119, 7326, 16504, 7667, 108]
Anura Vast
avn_014_dot3
diff8.0+0.08
ELO    -11.07 +- 8.81 (95%)
LLR    -2.28 (-2.25, 2.89) [0.00, 5.00]
GAMES  N: 3046 W: 848 L: 945 D: 1253
PENTA  [117, 391, 568, 366, 81]
Caissa Witek
1_23_bmi2
diff5.0+0.05
ELO    0.28 +- 1.66 (95%)
LLR    -0.39 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 49384 W: 12369 L: 12329 D: 24686
PENTA  [356, 5756, 12433, 5786, 361]
Anura Vast
datagen
diffN=1000
ELO    -0.09 +- 0.10 (95%)
GAMES  N: 15000744/15000000 W: 2446634 L: 2450407 D: 10103703
Vine SwedishChef
more_clever_feature_unrolling
diff4.0+0.04
ELO    -1.94 +- 1.23 (95%)
LLR    -1.46 (-2.25, 2.89) [-5.00, 0.00]
GAMES  N: 156048 W: 49020 L: 49893 D: 57135
PENTA  [5712, 17604, 31925, 17411, 5372]
Anura Vast
apn_016_warmup
diff8.0+0.08
ELO    -3.88 +- 5.75 (95%)
LLR    -2.31 (-2.25, 2.89) [0.00, 5.00]
GAMES  N: 6986 W: 1977 L: 2055 D: 2954
PENTA  [243, 846, 1355, 844, 205]
Anura Vast
apn_016_2xlr
diff8.0+0.08
ELO    -5.39 +- 6.47 (95%)
LLR    -2.27 (-2.25, 2.89) [0.00, 5.00]
GAMES  N: 5346 W: 1531 L: 1614 D: 2201
PENTA  [171, 664, 1068, 617, 153]
Anura Vast
apn_015_2xlr
diff8.0+0.08
ELO    8.98 +- 5.79 (95%)
LLR    2.90 (-2.25, 2.89) [0.00, 5.00]
GAMES  N: 6776 W: 2042 L: 1867 D: 2867
PENTA  [187, 783, 1315, 874, 229]
Vine SwedishChef
unroll_features_policy
diff4.0+0.04
ELO    4.10 +- 3.31 (95%)
LLR    2.90 (-2.25, 2.89) [0.00, 5.00]
GAMES  N: 21092 W: 6816 L: 6567 D: 7709
PENTA  [699, 2286, 4368, 2453, 740]
Quanticade DarkNeutrino
higher-quality-tt-cutoff
diff10.0+0.10
ELO    -5.47 +- 3.62 (95%)
LLR    -2.25 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 9016 W: 2009 L: 2151 D: 4856
PENTA  [9, 1173, 2299, 1005, 22]
Vine Fury
combined_v28_p8_test
diff10.0+0.10
ELO    -276.84 +- 42.42 (95%)
LLR    -2.53 (-2.25, 2.89) [0.00, 5.00]
GAMES  N: 302 W: 20 L: 220 D: 62
PENTA  [77, 48, 24, 2, 0]
Vine Fury
div_cpuct
diff40.0+0.40
ELO    -12.83 +- 12.72 (95%)
LLR    -1.11 (-2.25, 2.89) [0.00, 5.00]
GAMES  N: 1192 W: 298 L: 342 D: 552
PENTA  [37, 140, 267, 134, 18]