FuryBench Testing Framework

home toIntegralPlentyChessObsidianCaissaQuanticadeSerendipitySpaghetSchoenemannClarityIlluminaPawnocchioVineAnura
Active : 13 Machines / 186 Threads / 111.11 MNPS
Priority 0
Integral Fury
tt_cutoff_shenanigans
diff40.0+0.40
ELO    1.19 +- 1.59 (95%)
LLR    1.05 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 41322 W: 10179 L: 10037 D: 21106
PENTA  [10, 4535, 11429, 4677, 10]
Caissa Witek
eval-ml-8-dtm-b0-v2
Endgames: Remove KBNvK endgame evaluator KBNvK was preferred more than other, more winning endgame, leading to draws in winning positions. STC, KBNvK_dtz60.epd: Results of New vs Old (6+0.06, 1t, 8MB, KBNvK_dtz60.epd): Elo: 95.95 +/- 12.31, nElo: 234.36 +/- 28.57 LOS: 100.00 %, DrawRatio: 45.42 %, PairsRatio: 37.75 Games: 568, Wins: 164, Losses: 11, Draws: 393, Points: 360.5 (63.47 %) Ptnml(0-2): [0, 4, 129, 145, 6], WL/DD Ratio: 0.06 LLR: 2.95 (100.0%) (-2.94, 2.94) [0.00, 5.00] STC, endgames_cdb95105.epd: ELO 11.02 +- 3.49 (95%) SPRT 10.0+0.10s Threads=1 Hash=16MB LLR 3.00 (-2.94, 2.94) [0.00, 2.00] GAMES N: 7758 W: 1948 L: 1702 D: 4108 PENTA [2, 667, 2293, 917, 0] https://furybench.com/test/7502/
diff10.0+0.10
ELO    1.82 +- 3.44 (95%)
LLR    0.40 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 8220 W: 1975 L: 1932 D: 4313
PENTA  [2, 830, 2404, 871, 3]
Quanticade DarkNeutrino
master
25K node datagen.
diffN=25000
ELO    -0.13 +- 0.13 (95%)
GAMES  N: 20536036/30000000 W: 7204575 L: 7212307 D: 6119154
Priority -1
Caissa Witek
pairwise-rounding
Neural net: Use rounding to nearest in pairwise multiplication
diff10.0+0.10
ELO    0.45 +- 0.70 (95%)
LLR    -0.56 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 258546 W: 61618 L: 61282 D: 135646
PENTA  [963, 30840, 65309, 31220, 941]
Caissa Witek
qs-conthist-fix
QSearch: Fix uninitialized cont history pointers
diff10.0+0.10
ELO    -0.40 +- 1.83 (95%)
LLR    -1.06 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 35890 W: 8410 L: 8451 D: 19029
PENTA  [96, 4290, 9211, 4255, 93]
Finished
Integral Fury
rounded_pairwise
Round the pairwise FT product instead of flooring it
diff10.0+0.10
ELO    0.60 +- 1.03 (95%)
LLR    -0.83 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 109698 W: 27464 L: 27275 D: 54959
PENTA  [223, 12801, 28616, 12982, 227]
Caissa Witek
cont1-weight
diff10.0+0.10
ELO    -0.63 +- 1.25 (95%)
LLR    -2.96 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 81132 W: 19440 L: 19586 D: 42106
PENTA  [330, 9780, 20485, 9648, 323]
Caissa Witek
lmr-seen-index
diff10.0+0.10
ELO    -0.65 +- 1.27 (95%)
LLR    -2.95 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 79348 W: 18900 L: 19049 D: 41399
PENTA  [359, 9594, 19889, 9501, 331]
Integral Fury
16kb_no_hmc
diff40.0+0.40
ELO    2.17 +- 1.64 (95%)
LLR    2.99 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 39946 W: 9956 L: 9706 D: 20284
PENTA  [24, 4418, 10838, 4670, 23]
Integral Fury
16kb_no_hmc
diff10.0+0.10
ELO    4.23 +- 2.65 (95%)
LLR    2.90 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 17076 W: 4258 L: 4050 D: 8768
PENTA  [37, 1948, 4366, 2144, 43]
Caissa Witek
no-kbnvk
diff10.0+0.10
ELO    11.02 +- 3.49 (95%)
LLR    3.00 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 7758 W: 1948 L: 1702 D: 4108
PENTA  [2, 667, 2293, 917, 0]
Integral Fury
16kb_no_hmc
diffN=25000
ELO    3.28 +- 2.40 (95%)
LLR    2.89 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 30086 W: 8695 L: 8411 D: 12980
PENTA  [484, 3503, 6818, 3721, 517]
Caissa Witek
qsearch-history-bonus
diff10.0+0.10
ELO    -0.09 +- 0.89 (95%)
LLR    -3.10 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 158698 W: 37704 L: 37746 D: 83248
PENTA  [553, 19088, 40140, 18984, 584]
Illumina Mergener
remove-board-listener
Remove board listeners
diff8.0+0.08
ELO    1.59 +- 1.89 (95%)
LLR    0.71 (-2.25, 2.89) [0.00, 5.00]
GAMES  N: 37650 W: 8386 L: 8214 D: 21050
PENTA  [211, 4485, 9281, 4617, 231]
Vine SwedishChef
rep_fix
Merge branch 'main' into rep_fix
diff40.0+0.40
ELO    6.36 +- 5.03 (95%)
LLR    2.91 (-2.25, 2.89) [-5.00, 0.00]
GAMES  N: 4646 W: 894 L: 809 D: 2943
PENTA  [14, 485, 1246, 558, 20]
Vine SwedishChef
dpbusd
proper inference
diff4.0+0.04
ELO    14.01 +- 6.63 (95%)
LLR    3.15 (-2.25, 2.89) [0.00, 5.00]
GAMES  N: 3498 W: 840 L: 699 D: 1959
PENTA  [35, 363, 820, 488, 43]
Vine SwedishChef
rep_fix
repetition detection fix
diff10.0+0.10
ELO    2.00 +- 3.46 (95%)
LLR    2.90 (-2.25, 2.89) [-5.00, 0.00]
GAMES  N: 11274 W: 2434 L: 2369 D: 6471
PENTA  [84, 1288, 2810, 1389, 66]
Vine SwedishChef
zoom
diff4.0+0.04
ELO    7.08 +- 9.01 (95%)
LLR    0.73 (-2.25, 2.89) [0.00, 5.00]
GAMES  N: 1668 W: 375 L: 341 D: 952
PENTA  [14, 174, 420, 216, 10]
Integral Fury
16kb
diff10.0+0.10
ELO    -8.33 +- 4.86 (95%)
LLR    -2.28 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 5174 W: 1240 L: 1364 D: 2570
PENTA  [22, 668, 1320, 566, 11]
Integral Fury
tt_cutoff_shenanigans
diff10.0+0.10
ELO    2.46 +- 1.81 (95%)
LLR    2.99 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 35092 W: 8740 L: 8492 D: 17860
PENTA  [47, 4032, 9156, 4248, 63]