FuryBench Testing Framework

home toIntegralPlentyChessObsidianCaissaQuanticadeSerendipitySpaghetSchoenemannClarityIlluminaPawnocchioVineAnura
No logs for event exist
Active : 16 Machines / 458 Threads / 306.14 MNPS
Priority 0
Quanticade DarkNeutrino
master
25K node datagen.
diffN=25000
ELO    -0.10 +- 0.12 (95%)
GAMES  N: 24168314/30000000 W: 8480838 L: 8487997 D: 7199479
Integral Fury
seval_update_shenanigans
diff10.0+0.10
ELO    -15.34 +- 37.49 (95%)
LLR    -0.06 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 68 W: 18 L: 21 D: 29
PENTA  [0, 8, 21, 5, 0]
Integral Fury
bad_noisy_capthist_bonus
diff10.0+0.10
ELO    -1.22 +- 4.52 (95%)
LLR    -0.56 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 5682 W: 1373 L: 1393 D: 2916
PENTA  [14, 670, 1487, 662, 8]
PlentyChess Yoshie2000
hp-cap-only-bad
diff8.0+0.08
ELO    -0.16 +- 1.70 (95%)
LLR    -1.28 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 39578 W: 9534 L: 9552 D: 20492
PENTA  [52, 4684, 10349, 4638, 66]
Integral Fury
mp_gives_check_see
diff10.0+0.10
ELO    -2.88 +- 3.16 (95%)
LLR    -2.09 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 11570 W: 2801 L: 2897 D: 5872
PENTA  [19, 1415, 3007, 1331, 13]
Priority -1
Caissa Witek
pairwise-rounding
Neural net: Use rounding to nearest in pairwise multiplication
diff10.0+0.10
ELO    0.47 +- 0.69 (95%)
LLR    -0.38 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 259070 W: 61746 L: 61393 D: 135931
PENTA  [963, 30900, 65436, 31293, 943]
Caissa Witek
qs-conthist-fix
QSearch: Fix uninitialized cont history pointers
diff10.0+0.10
ELO    -0.30 +- 1.82 (95%)
LLR    -0.95 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 36178 W: 8486 L: 8517 D: 19175
PENTA  [96, 4322, 9283, 4293, 95]
Finished
Integral Fury
[PlentyChess] main
diff40.0+0.40
ELO    -2.09 +- 4.48 (95%)
GAMES  N: 5324/10000 W: 1295 L: 1327 D: 2702
PENTA  [5, 613, 1455, 587, 2]
PlentyChess Yoshie2000
rfp-cn-margin-2
diff8.0+0.08
ELO    -0.64 +- 1.61 (95%)
LLR    -2.29 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 43710 W: 10585 L: 10665 D: 22460
PENTA  [48, 5187, 11477, 5083, 60]
Integral Fury
main
Bad Noisy Futility Pruning (#259)
diff40.0+0.40
ELO    32.48 +- 4.65 (95%)
GAMES  N: 5000/5000 W: 1443 L: 977 D: 2580
PENTA  [2, 367, 1302, 821, 8]
PlentyChess Yoshie2000
fp-search-first-quiet-check
diff8.0+0.08
ELO    -0.00 +- 1.15 (95%)
LLR    -2.27 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 87518 W: 21268 L: 21268 D: 44982
PENTA  [134, 10448, 22584, 10470, 123]
Integral Fury
bad_noisy_fp_attempt_1bajillion
diff10.0+0.10
ELO    2.12 +- 1.65 (95%)
LLR    2.92 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 43212 W: 10786 L: 10522 D: 21904
PENTA  [101, 4934, 11258, 5226, 87]
PlentyChess Yoshie2000
fix-one-singular
diff8.0+0.08
ELO    1.07 +- 1.92 (95%)
LLR    2.94 (-2.25, 2.89) [-3.00, 1.00]
GAMES  N: 26674 W: 6611 L: 6529 D: 13534
PENTA  [35, 2634, 7926, 2698, 44]
Integral Fury
tm_fixes
diff40.0+0.40
ELO    11.06 +- 10.87 (95%)
LLR    0.61 (-2.25, 2.89) [-3.00, 1.00]
GAMES  N: 660 W: 171 L: 150 D: 339
PENTA  [0, 45, 219, 66, 0]
Caissa Witek
eval-ml-8-dtm-b0-v2
Endgames: Remove KBNvK endgame evaluator KBNvK was preferred more than other, more winning endgame, leading to draws in winning positions. STC, KBNvK_dtz60.epd: Results of New vs Old (6+0.06, 1t, 8MB, KBNvK_dtz60.epd): Elo: 95.95 +/- 12.31, nElo: 234.36 +/- 28.57 LOS: 100.00 %, DrawRatio: 45.42 %, PairsRatio: 37.75 Games: 568, Wins: 164, Losses: 11, Draws: 393, Points: 360.5 (63.47 %) Ptnml(0-2): [0, 4, 129, 145, 6], WL/DD Ratio: 0.06 LLR: 2.95 (100.0%) (-2.94, 2.94) [0.00, 5.00] STC, endgames_cdb95105.epd: ELO 11.02 +- 3.49 (95%) SPRT 10.0+0.10s Threads=1 Hash=16MB LLR 3.00 (-2.94, 2.94) [0.00, 2.00] GAMES N: 7758 W: 1948 L: 1702 D: 4108 PENTA [2, 667, 2293, 917, 0] https://furybench.com/test/7502/
diff10.0+0.10
ELO    0.04 +- 0.71 (95%)
LLR    -2.98 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 195736 W: 46754 L: 46733 D: 102249
PENTA  [38, 20427, 56918, 20446, 39]
PlentyChess Yoshie2000
rfp-cn-margin
diff8.0+0.08
ELO    -1.23 +- 1.96 (95%)
LLR    -2.30 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 30014 W: 7256 L: 7362 D: 15396
PENTA  [53, 3593, 7815, 3499, 47]
Integral Fury
tm_fixes
diff2.0+0.02
ELO    -1.79 +- 2.13 (95%)
LLR    -2.26 (-2.25, 2.89) [-3.00, 1.00]
GAMES  N: 28936 W: 7279 L: 7428 D: 14229
PENTA  [213, 3322, 7555, 3157, 221]
Integral Fury
tm_fixes
diff2.0+0.02
ELO    -3.61 +- 4.01 (95%)
LLR    -1.55 (-2.25, 2.89) [-3.00, 1.00]
GAMES  N: 7986 W: 1995 L: 2078 D: 3913
PENTA  [49, 943, 2101, 842, 58]
Integral Fury
fix_asp_fail_high_red
diff10.0+0.10
ELO    -1.36 +- 2.64 (95%)
LLR    -0.92 (-2.25, 2.89) [-3.00, 1.00]
GAMES  N: 14864 W: 3659 L: 3717 D: 7488
PENTA  [23, 1589, 4271, 1521, 28]
PlentyChess Yoshie2000
lmp-search-first-quiet-check
diff8.0+0.08
ELO    -1.15 +- 1.93 (95%)
LLR    -2.26 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 30576 W: 7309 L: 7410 D: 15857
PENTA  [39, 3650, 8011, 3549, 39]
Quanticade DarkNeutrino
[Obsidian] main
search.c: Add correction margin to SE (#438)
diff10.0+0.10
ELO    -9.83 +- 5.15 (95%)
GAMES  N: 5020/5000 W: 1191 L: 1333 D: 2496
PENTA  [24, 699, 1203, 563, 21]
PlentyChess Yoshie2000
lmr-impcap-stale-2
diff40.0+0.40
ELO    -1.35 +- 2.67 (95%)
LLR    -1.24 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 14720 W: 3498 L: 3555 D: 7667
PENTA  [3, 1679, 4052, 1624, 2]