FuryBench Testing Framework

home toIntegralPlentyChessObsidianCaissaQuanticadeSerendipitySpaghetSchoenemannClarityIlluminaPawnocchioVineAnura
Active : 13 Machines / 180 Threads / 104.56 MNPS
Priority 0
Quanticade DarkNeutrino
master
25K node datagen.
diffN=25000
ELO    -0.11 +- 0.11 (95%)
GAMES  N: 25133588/30000000 W: 8819542 L: 8827373 D: 7486673
Illumina Mergener
reorder-qsearch
Reorder qsearch
diff8.0+0.08
ELO    -3.59 +- 17.96 (95%)
LLR    -0.18 (-2.25, 2.89) [0.00, 5.00]
GAMES  N: 484 W: 105 L: 110 D: 269
PENTA  [9, 52, 120, 57, 4]
PlentyChess Yoshie2000
no-ttpv-razor
diff8.0+0.08
ELO    0.30 +- 1.44 (95%)
LLR    -0.72 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 54746 W: 13289 L: 13241 D: 28216
PENTA  [77, 6393, 14383, 6445, 75]
Caissa Witek
pairwise-rounding
Neural net: Use rounding to nearest in pairwise multiplication
diff10.0+0.10
ELO    0.44 +- 0.62 (95%)
LLR    -0.87 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 327338 W: 78064 L: 77654 D: 171620
PENTA  [1188, 39073, 82732, 39493, 1183]
PlentyChess Yoshie2000
no-pv-razor
diff8.0+0.08
ELO    -0.73 +- 2.00 (95%)
LLR    -1.61 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 28666 W: 6962 L: 7022 D: 14682
PENTA  [58, 3367, 7521, 3351, 36]
Priority -1
Illumina Mergener
fix-increments
diff40.0+0.40
TUNE   5 parameters
ITER   469 / 500
GAMES  7,516 / 8,000
Illumina Mergener
capture-pruning
Capture pruning
diff8.0+0.08
ELO    -1.82 +- 8.82 (95%)
LLR    -0.42 (-2.25, 2.89) [0.00, 5.00]
GAMES  N: 1718 W: 366 L: 375 D: 977
PENTA  [10, 210, 429, 199, 11]
Caissa Witek
qs-conthist-fix
QSearch: Fix uninitialized cont history pointers
diff10.0+0.10
ELO    -0.30 +- 1.82 (95%)
LLR    -0.95 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 36178 W: 8486 L: 8517 D: 19175
PENTA  [96, 4322, 9283, 4293, 95]
Illumina Mergener
pawn-history
Butterfly pawn history
diff8.0+0.08
ELO    -5.39 +- 8.54 (95%)
LLR    -0.96 (-2.25, 2.89) [0.00, 5.00]
GAMES  N: 1868 W: 392 L: 421 D: 1055
PENTA  [11, 246, 447, 221, 9]
Finished
Illumina Mergener
pawn-history
Fix compile error
diff8.0+0.08
ELO    -2.89 +- 4.44 (95%)
LLR    -2.26 (-2.25, 2.89) [0.00, 5.00]
GAMES  N: 6972 W: 1531 L: 1589 D: 3852
PENTA  [38, 896, 1688, 814, 50]
Integral Fury
lmr_eval_alpha_diff
diff10.0+0.10
ELO    -0.37 +- 1.68 (95%)
LLR    -2.26 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 40582 W: 9884 L: 9927 D: 20771
PENTA  [71, 4728, 10729, 4699, 64]
Integral Fury
lets_think_about_killers_differently
diff10.0+0.10
ELO    -2.72 +- 2.95 (95%)
LLR    -2.25 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 12920 W: 3110 L: 3211 D: 6599
PENTA  [18, 1541, 3448, 1430, 23]
Integral Fury
seval_update_shenanigans
diff10.0+0.10
ELO    -5.93 +- 4.18 (95%)
LLR    -2.19 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 6564 W: 1551 L: 1663 D: 3350
PENTA  [14, 819, 1721, 721, 7]
Integral Fury
seval_update_shenanigans
diff10.0+0.10
ELO    0.26 +- 1.82 (95%)
LLR    -0.85 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 34744 W: 8517 L: 8491 D: 17736
PENTA  [59, 4067, 9099, 4083, 64]
Integral Fury
bad_noisy_capthist_bonus
diff10.0+0.10
ELO    -0.58 +- 1.84 (95%)
LLR    -2.25 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 33922 W: 8268 L: 8325 D: 17329
PENTA  [60, 3989, 8919, 3934, 59]
PlentyChess Yoshie2000
hp-cap-only-bad
diff8.0+0.08
ELO    0.13 +- 1.47 (95%)
LLR    -1.09 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 53176 W: 12853 L: 12833 D: 27490
PENTA  [73, 6269, 13906, 6245, 95]
Integral Fury
mp_gives_check_see
diff10.0+0.10
ELO    -3.12 +- 3.14 (95%)
LLR    -2.26 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 11702 W: 2836 L: 2941 D: 5925
PENTA  [20, 1431, 3047, 1340, 13]
Integral Fury
[PlentyChess] main
diff40.0+0.40
ELO    -2.09 +- 4.48 (95%)
GAMES  N: 5324/10000 W: 1295 L: 1327 D: 2702
PENTA  [5, 613, 1455, 587, 2]
PlentyChess Yoshie2000
rfp-cn-margin-2
diff8.0+0.08
ELO    -0.64 +- 1.61 (95%)
LLR    -2.29 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 43710 W: 10585 L: 10665 D: 22460
PENTA  [48, 5187, 11477, 5083, 60]
Integral Fury
main
Bad Noisy Futility Pruning (#259)
diff40.0+0.40
ELO    32.48 +- 4.65 (95%)
GAMES  N: 5000/5000 W: 1443 L: 977 D: 2580
PENTA  [2, 367, 1302, 821, 8]
PlentyChess Yoshie2000
fp-search-first-quiet-check
diff8.0+0.08
ELO    -0.00 +- 1.15 (95%)
LLR    -2.27 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 87518 W: 21268 L: 21268 D: 44982
PENTA  [134, 10448, 22584, 10470, 123]
Integral Fury
bad_noisy_fp_attempt_1bajillion
diff10.0+0.10
ELO    2.12 +- 1.65 (95%)
LLR    2.92 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 43212 W: 10786 L: 10522 D: 21904
PENTA  [101, 4934, 11258, 5226, 87]
PlentyChess Yoshie2000
fix-one-singular
diff8.0+0.08
ELO    1.07 +- 1.92 (95%)
LLR    2.94 (-2.25, 2.89) [-3.00, 1.00]
GAMES  N: 26674 W: 6611 L: 6529 D: 13534
PENTA  [35, 2634, 7926, 2698, 44]
Integral Fury
tm_fixes
diff40.0+0.40
ELO    11.06 +- 10.87 (95%)
LLR    0.61 (-2.25, 2.89) [-3.00, 1.00]
GAMES  N: 660 W: 171 L: 150 D: 339
PENTA  [0, 45, 219, 66, 0]