FuryBench Testing Framework

home toIntegralPlentyChessObsidianCaissaQuanticadeSerendipitySpaghetSchoenemannClarityIlluminaPawnocchioVineAnura
Active : 14 Machines / 186 Threads / 99.97 MNPS
Priority 0
PlentyChess Yoshie2000
fp-search-first-quiet-check
diff8.0+0.08
ELO    1.09 +- 1.51 (95%)
LLR    0.99 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 50866 W: 12386 L: 12226 D: 26254
PENTA  [74, 5958, 13210, 6116, 75]
Quanticade DarkNeutrino
master
25K node datagen.
diffN=25000
ELO    -0.11 +- 0.12 (95%)
GAMES  N: 23293864/30000000 W: 8173735 L: 8181115 D: 6939014
Priority -1
Caissa Witek
pairwise-rounding
Neural net: Use rounding to nearest in pairwise multiplication
diff10.0+0.10
ELO    0.47 +- 0.69 (95%)
LLR    -0.38 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 259070 W: 61746 L: 61393 D: 135931
PENTA  [963, 30900, 65436, 31293, 943]
Caissa Witek
qs-conthist-fix
QSearch: Fix uninitialized cont history pointers
diff10.0+0.10
ELO    -0.30 +- 1.82 (95%)
LLR    -0.95 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 36178 W: 8486 L: 8517 D: 19175
PENTA  [96, 4322, 9283, 4293, 95]
Finished
Integral Fury
bad_noisy_fp_attempt_1bajillion
diff10.0+0.10
ELO    2.12 +- 1.65 (95%)
LLR    2.92 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 43212 W: 10786 L: 10522 D: 21904
PENTA  [101, 4934, 11258, 5226, 87]
PlentyChess Yoshie2000
fix-one-singular
diff8.0+0.08
ELO    1.07 +- 1.92 (95%)
LLR    2.94 (-2.25, 2.89) [-3.00, 1.00]
GAMES  N: 26674 W: 6611 L: 6529 D: 13534
PENTA  [35, 2634, 7926, 2698, 44]
Integral Fury
tm_fixes
diff40.0+0.40
ELO    11.06 +- 10.87 (95%)
LLR    0.61 (-2.25, 2.89) [-3.00, 1.00]
GAMES  N: 660 W: 171 L: 150 D: 339
PENTA  [0, 45, 219, 66, 0]
Caissa Witek
eval-ml-8-dtm-b0-v2
Endgames: Remove KBNvK endgame evaluator KBNvK was preferred more than other, more winning endgame, leading to draws in winning positions. STC, KBNvK_dtz60.epd: Results of New vs Old (6+0.06, 1t, 8MB, KBNvK_dtz60.epd): Elo: 95.95 +/- 12.31, nElo: 234.36 +/- 28.57 LOS: 100.00 %, DrawRatio: 45.42 %, PairsRatio: 37.75 Games: 568, Wins: 164, Losses: 11, Draws: 393, Points: 360.5 (63.47 %) Ptnml(0-2): [0, 4, 129, 145, 6], WL/DD Ratio: 0.06 LLR: 2.95 (100.0%) (-2.94, 2.94) [0.00, 5.00] STC, endgames_cdb95105.epd: ELO 11.02 +- 3.49 (95%) SPRT 10.0+0.10s Threads=1 Hash=16MB LLR 3.00 (-2.94, 2.94) [0.00, 2.00] GAMES N: 7758 W: 1948 L: 1702 D: 4108 PENTA [2, 667, 2293, 917, 0] https://furybench.com/test/7502/
diff10.0+0.10
ELO    0.04 +- 0.71 (95%)
LLR    -2.98 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 195736 W: 46754 L: 46733 D: 102249
PENTA  [38, 20427, 56918, 20446, 39]
PlentyChess Yoshie2000
rfp-cn-margin
diff8.0+0.08
ELO    -1.23 +- 1.96 (95%)
LLR    -2.30 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 30014 W: 7256 L: 7362 D: 15396
PENTA  [53, 3593, 7815, 3499, 47]
Integral Fury
tm_fixes
diff2.0+0.02
ELO    -1.79 +- 2.13 (95%)
LLR    -2.26 (-2.25, 2.89) [-3.00, 1.00]
GAMES  N: 28936 W: 7279 L: 7428 D: 14229
PENTA  [213, 3322, 7555, 3157, 221]
Integral Fury
tm_fixes
diff2.0+0.02
ELO    -3.61 +- 4.01 (95%)
LLR    -1.55 (-2.25, 2.89) [-3.00, 1.00]
GAMES  N: 7986 W: 1995 L: 2078 D: 3913
PENTA  [49, 943, 2101, 842, 58]
Integral Fury
fix_asp_fail_high_red
diff10.0+0.10
ELO    -1.36 +- 2.64 (95%)
LLR    -0.92 (-2.25, 2.89) [-3.00, 1.00]
GAMES  N: 14864 W: 3659 L: 3717 D: 7488
PENTA  [23, 1589, 4271, 1521, 28]
PlentyChess Yoshie2000
lmp-search-first-quiet-check
diff8.0+0.08
ELO    -1.15 +- 1.93 (95%)
LLR    -2.26 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 30576 W: 7309 L: 7410 D: 15857
PENTA  [39, 3650, 8011, 3549, 39]
Quanticade DarkNeutrino
[Obsidian] main
search.c: Add correction margin to SE (#438)
diff10.0+0.10
ELO    -9.83 +- 5.15 (95%)
GAMES  N: 5020/5000 W: 1191 L: 1333 D: 2496
PENTA  [24, 699, 1203, 563, 21]
PlentyChess Yoshie2000
lmr-impcap-stale-2
diff40.0+0.40
ELO    -1.35 +- 2.67 (95%)
LLR    -1.24 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 14720 W: 3498 L: 3555 D: 7667
PENTA  [3, 1679, 4052, 1624, 2]
PlentyChess Yoshie2000
se-cor
diff8.0+0.08
ELO    -6.88 +- 3.98 (95%)
LLR    -2.29 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 7424 W: 1708 L: 1855 D: 3861
PENTA  [17, 954, 1911, 819, 11]
Integral Fury
corrhist_bad_cap_again
diff10.0+0.10
ELO    0.05 +- 1.32 (95%)
LLR    -2.29 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 65642 W: 16234 L: 16225 D: 33183
PENTA  [93, 7736, 17173, 7707, 112]
PlentyChess Yoshie2000
lmr-impcap-stale
diff8.0+0.08
ELO    0.19 +- 1.25 (95%)
LLR    -1.31 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 72964 W: 17680 L: 17640 D: 37644
PENTA  [103, 8603, 19024, 8655, 97]
PlentyChess Yoshie2000
lmr-impcap-stale-3
diff8.0+0.08
ELO    -1.84 +- 2.29 (95%)
LLR    -2.26 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 22118 W: 5309 L: 5426 D: 11383
PENTA  [31, 2692, 5730, 2575, 31]