FuryBench Testing Framework

home toIntegralPlentyChessObsidianCaissaQuanticadeSerendipitySpaghetSchoenemannClarityIlluminaPawnocchioVineAnura
No logs for event exist
Active : 16 Machines / 210 Threads / 135.32 MNPS
Priority 0
Caissa Witek
eval-ml-8-dtm-b0-v2
Endgames: Remove KBNvK endgame evaluator KBNvK was preferred more than other, more winning endgame, leading to draws in winning positions. STC, KBNvK_dtz60.epd: Results of New vs Old (6+0.06, 1t, 8MB, KBNvK_dtz60.epd): Elo: 95.95 +/- 12.31, nElo: 234.36 +/- 28.57 LOS: 100.00 %, DrawRatio: 45.42 %, PairsRatio: 37.75 Games: 568, Wins: 164, Losses: 11, Draws: 393, Points: 360.5 (63.47 %) Ptnml(0-2): [0, 4, 129, 145, 6], WL/DD Ratio: 0.06 LLR: 2.95 (100.0%) (-2.94, 2.94) [0.00, 5.00] STC, endgames_cdb95105.epd: ELO 11.02 +- 3.49 (95%) SPRT 10.0+0.10s Threads=1 Hash=16MB LLR 3.00 (-2.94, 2.94) [0.00, 2.00] GAMES N: 7758 W: 1948 L: 1702 D: 4108 PENTA [2, 667, 2293, 917, 0] https://furybench.com/test/7502/
diff10.0+0.10
ELO    0.68 +- 0.93 (95%)
LLR    0.92 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 112354 W: 26919 L: 26698 D: 58737
PENTA  [20, 11564, 32786, 11789, 18]
Quanticade DarkNeutrino
master
same as before but LTC
diff60.0+0.60
ELO    31.04 +- 9.18 (95%)
GAMES  N: 1268/3000 W: 349 L: 236 D: 683
PENTA  [0, 94, 335, 203, 2]
Quanticade DarkNeutrino
master
25K node datagen.
diffN=25000
ELO    -0.11 +- 0.12 (95%)
GAMES  N: 22159330/30000000 W: 7775185 L: 7782468 D: 6601677
PlentyChess Yoshie2000
lmr-impcap-stale-2
diff40.0+0.40
ELO    -0.13 +- 3.16 (95%)
LLR    -0.33 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 10408 W: 2492 L: 2496 D: 5420
PENTA  [3, 1155, 2890, 1155, 1]
PlentyChess Yoshie2000
lmr-impcap-stale
diff8.0+0.08
ELO    0.22 +- 1.32 (95%)
LLR    -1.09 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 65740 W: 15944 L: 15902 D: 33894
PENTA  [92, 7739, 17155, 7803, 81]
Integral Fury
corrhist_bad_cap_again
diff10.0+0.10
ELO    -0.03 +- 1.91 (95%)
LLR    -1.25 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 32090 W: 7936 L: 7939 D: 16215
PENTA  [47, 3829, 8316, 3786, 67]
PlentyChess Yoshie2000
lmr-impcap-stale-3
diff8.0+0.08
ELO    -1.31 +- 2.44 (95%)
LLR    -1.55 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 19302 W: 4644 L: 4717 D: 9941
PENTA  [24, 2332, 5016, 2251, 28]
Integral Fury
bad_noisy_fp_attempt_1bajillion
diff10.0+0.10
ELO    -3.21 +- 3.52 (95%)
LLR    -1.83 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 9194 W: 2198 L: 2283 D: 4713
PENTA  [20, 1094, 2449, 1019, 15]
Priority -1
Caissa Witek
pairwise-rounding
Neural net: Use rounding to nearest in pairwise multiplication
diff10.0+0.10
ELO    0.47 +- 0.69 (95%)
LLR    -0.38 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 259070 W: 61746 L: 61393 D: 135931
PENTA  [963, 30900, 65436, 31293, 943]
Caissa Witek
qs-conthist-fix
QSearch: Fix uninitialized cont history pointers
diff10.0+0.10
ELO    -0.30 +- 1.82 (95%)
LLR    -0.95 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 36178 W: 8486 L: 8517 D: 19175
PENTA  [96, 4322, 9283, 4293, 95]
Finished
Quanticade DarkNeutrino
master
Master against last dev prerelease to see whats up
diff10.0+0.10
ELO    32.77 +- 9.60 (95%)
GAMES  N: 1244/10000 W: 357 L: 240 D: 647
PENTA  [2, 91, 322, 202, 5]
Integral Fury
decouple_ttpv_lmr
diff10.0+0.10
ELO    -0.07 +- 1.65 (95%)
LLR    -1.72 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 42516 W: 10427 L: 10435 D: 21654
PENTA  [75, 5036, 11042, 5032, 73]
PlentyChess Yoshie2000
lmr-impcap-stale-2
diff8.0+0.08
ELO    -2.54 +- 2.57 (95%)
LLR    -2.27 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 17246 W: 4098 L: 4224 D: 8924
PENTA  [31, 2059, 4573, 1925, 35]
Integral Fury
double_razoring
diff10.0+0.10
ELO    -0.53 +- 1.80 (95%)
LLR    -2.28 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 35860 W: 8748 L: 8803 D: 18309
PENTA  [70, 4258, 9328, 4205, 69]
PlentyChess Yoshie2000
lmr-impcap-research-2
diff8.0+0.08
ELO    -0.97 +- 2.72 (95%)
LLR    -1.04 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 15808 W: 3823 L: 3867 D: 8118
PENTA  [21, 1932, 4040, 1892, 19]
PlentyChess Yoshie2000
lmr-impcap-research-1
diff8.0+0.08
ELO    0.24 +- 2.93 (95%)
LLR    -0.21 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 13266 W: 3242 L: 3233 D: 6791
PENTA  [14, 1562, 3479, 1557, 21]
Integral Fury
[PlentyChess] main
Update README
diff40.0+0.40
ELO    -5.26 +- 7.89 (95%)
GAMES  N: 1716/10000 W: 432 L: 458 D: 826
PENTA  [5, 194, 482, 176, 1]
Integral Fury
zapdos
Update README
diff40.0+0.40
ELO    5.23 +- 3.32 (95%)
LLR    2.93 (-2.25, 2.89) [0.00, 4.00]
GAMES  N: 10290 W: 2616 L: 2461 D: 5213
PENTA  [15, 1116, 2733, 1261, 20]
Integral Fury
zapdos
Update README
diff10.0+0.10
ELO    6.13 +- 3.70 (95%)
LLR    2.90 (-2.25, 2.89) [0.00, 4.00]
GAMES  N: 8610 W: 2181 L: 2029 D: 4400
PENTA  [16, 954, 2216, 1100, 19]
Integral Fury
l1reg
Update README
diffN=20000
ELO    4.27 +- 2.87 (95%)
LLR    2.92 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 22152 W: 6508 L: 6236 D: 9408
PENTA  [373, 2636, 4869, 2742, 456]
Integral Fury
tt_cutoff_shenanigans
diff40.0+0.40
ELO    0.88 +- 1.10 (95%)
LLR    0.76 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 86660 W: 21353 L: 21133 D: 44174
PENTA  [30, 9575, 23896, 9803, 26]
Integral Fury
rounded_pairwise
Round the pairwise FT product instead of flooring it
diff10.0+0.10
ELO    0.60 +- 1.03 (95%)
LLR    -0.83 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 109698 W: 27464 L: 27275 D: 54959
PENTA  [223, 12801, 28616, 12982, 227]
Caissa Witek
cont1-weight
diff10.0+0.10
ELO    -0.63 +- 1.25 (95%)
LLR    -2.96 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 81132 W: 19440 L: 19586 D: 42106
PENTA  [330, 9780, 20485, 9648, 323]
Caissa Witek
lmr-seen-index
diff10.0+0.10
ELO    -0.65 +- 1.27 (95%)
LLR    -2.95 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 79348 W: 18900 L: 19049 D: 41399
PENTA  [359, 9594, 19889, 9501, 331]
Integral Fury
16kb_no_hmc
diff40.0+0.40
ELO    2.17 +- 1.64 (95%)
LLR    2.99 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 39946 W: 9956 L: 9706 D: 20284
PENTA  [24, 4418, 10838, 4670, 23]