FuryBench Testing Framework

home toIntegralPlentyChessObsidianCaissaQuanticadeSerendipitySpaghetSchoenemannClarityIlluminaPawnocchioVineAnura
No logs for event exist
Active : 8 Machines / 206 Threads / 174.05 MNPS
Priority 0
Integral Fury
rounded_pairwise
Round the pairwise FT product instead of flooring it
diff10.0+0.10
ELO    1.29 +- 1.59 (95%)
LLR    1.22 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 45956 W: 11568 L: 11398 D: 22990
PENTA  [89, 5298, 12036, 5464, 91]
Integral Fury
tt_cutoff_shenanigans
diff40.0+0.40
ELO    0.90 +- 1.92 (95%)
LLR    0.28 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 28236 W: 6915 L: 6842 D: 14479
PENTA  [9, 3084, 7856, 3163, 6]
Quanticade DarkNeutrino
master
25K node datagen.
diffN=25000
ELO    -0.11 +- 0.13 (95%)
GAMES  N: 18567274/30000000 W: 6514275 L: 6519898 D: 5533101
Caissa Witek
pairwise-rounding
Neural net: Use rounding to nearest in pairwise multiplication
diff10.0+0.10
ELO    -0.40 +- 2.53 (95%)
LLR    -0.58 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 19868 W: 4682 L: 4705 D: 10481
PENTA  [81, 2403, 4999, 2360, 91]
Priority -1
Caissa Witek
cont1-weight
diff10.0+0.10
ELO    0.54 +- 1.56 (95%)
LLR    0.03 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 52238 W: 12678 L: 12597 D: 26963
PENTA  [222, 6218, 13163, 6289, 227]
Caissa Witek
lmr-seen-index
diff10.0+0.10
ELO    0.41 +- 1.66 (95%)
LLR    -0.17 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 47158 W: 11233 L: 11177 D: 24748
PENTA  [238, 5628, 11772, 5722, 219]
Caissa Witek
qs-conthist-fix
QSearch: Fix uninitialized cont history pointers
diff10.0+0.10
ELO    -0.08 +- 1.87 (95%)
LLR    -0.66 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 34130 W: 8005 L: 8013 D: 18112
PENTA  [89, 4059, 8774, 4057, 86]
Finished
Integral Fury
16kb_no_hmc
diffN=25000
ELO    3.28 +- 2.40 (95%)
LLR    2.89 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 30086 W: 8695 L: 8411 D: 12980
PENTA  [484, 3503, 6818, 3721, 517]
Caissa Witek
qsearch-history-bonus
diff10.0+0.10
ELO    -0.09 +- 0.89 (95%)
LLR    -3.10 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 158698 W: 37704 L: 37746 D: 83248
PENTA  [553, 19088, 40140, 18984, 584]
Illumina Mergener
remove-board-listener
Remove board listeners
diff8.0+0.08
ELO    1.59 +- 1.89 (95%)
LLR    0.71 (-2.25, 2.89) [0.00, 5.00]
GAMES  N: 37650 W: 8386 L: 8214 D: 21050
PENTA  [211, 4485, 9281, 4617, 231]
Vine SwedishChef
rep_fix
Merge branch 'main' into rep_fix
diff40.0+0.40
ELO    6.36 +- 5.03 (95%)
LLR    2.91 (-2.25, 2.89) [-5.00, 0.00]
GAMES  N: 4646 W: 894 L: 809 D: 2943
PENTA  [14, 485, 1246, 558, 20]
Vine SwedishChef
dpbusd
proper inference
diff4.0+0.04
ELO    14.01 +- 6.63 (95%)
LLR    3.15 (-2.25, 2.89) [0.00, 5.00]
GAMES  N: 3498 W: 840 L: 699 D: 1959
PENTA  [35, 363, 820, 488, 43]
Vine SwedishChef
rep_fix
repetition detection fix
diff10.0+0.10
ELO    2.00 +- 3.46 (95%)
LLR    2.90 (-2.25, 2.89) [-5.00, 0.00]
GAMES  N: 11274 W: 2434 L: 2369 D: 6471
PENTA  [84, 1288, 2810, 1389, 66]
Vine SwedishChef
zoom
diff4.0+0.04
ELO    7.08 +- 9.01 (95%)
LLR    0.73 (-2.25, 2.89) [0.00, 5.00]
GAMES  N: 1668 W: 375 L: 341 D: 952
PENTA  [14, 174, 420, 216, 10]
Integral Fury
16kb
diff10.0+0.10
ELO    -8.33 +- 4.86 (95%)
LLR    -2.28 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 5174 W: 1240 L: 1364 D: 2570
PENTA  [22, 668, 1320, 566, 11]
Integral Fury
tt_cutoff_shenanigans
diff10.0+0.10
ELO    2.46 +- 1.81 (95%)
LLR    2.99 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 35092 W: 8740 L: 8492 D: 17860
PENTA  [47, 4032, 9156, 4248, 63]
Integral Fury
16kb
diffN=25000
ELO    -4.84 +- 4.15 (95%)
LLR    -2.35 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 10058 W: 2734 L: 2874 D: 4450
PENTA  [178, 1266, 2254, 1180, 151]
Integral Fury
sf_se_idea_again
diff10.0+0.10
ELO    -0.93 +- 3.56 (95%)
LLR    -0.66 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 7510 W: 1868 L: 1888 D: 3754
PENTA  [9, 747, 2260, 733, 6]
Caissa Witek
conthist-summed-gravity
Search: Continuation history gravity uses summed scores
diff10.0+0.10
ELO    -13.41 +- 4.32 (95%)
LLR    -2.95 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 6634 W: 1459 L: 1715 D: 3460
PENTA  [30, 911, 1681, 675, 20]
Caissa Witek
corrhist-skip-endgame-eval
diff10.0+0.10
ELO    0.67 +- 1.01 (95%)
LLR    0.72 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 95532 W: 24240 L: 24057 D: 47235
PENTA  [25, 9828, 27865, 10035, 13]
Caissa Witek
eval-ml-9-106B-permuted.pnn
Search: Do not apply IIR in root nodes ELO 0.97 +- 1.40 (95%) SPRT 10.0+0.10s Threads=1 Hash=8MB LLR 2.96 (-2.94, 2.94) [-2.00, 0.00] GAMES N: 61664 W: 14724 L: 14552 D: 32388 PENTA [247, 7026, 16082, 7262, 215] https://furybench.com/test/7475/
diffN=25000
ELO    0.45 +- 1.47 (95%)
LLR    -0.48 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 92356 W: 27621 L: 27502 D: 37233
PENTA  [2181, 10899, 20013, 10790, 2295]
Caissa Witek
tt-cutoff-margin
diff10.0+0.10
ELO    1.35 +- 1.06 (95%)
LLR    2.95 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 112192 W: 26924 L: 26487 D: 58781
PENTA  [476, 13289, 28092, 13800, 439]