FuryBench Testing Framework

home toIntegralPlentyChessObsidianCaissaQuanticadeSerendipitySpaghetSchoenemannClarityIlluminaPawnocchioVineAnura
Active : 25 Machines / 462 Threads / 296.45 MNPS
Priority 0
Caissa Witek
improving-default-true-nolmr
diff10.0+0.10
ELO    0.96 +- 1.05 (95%)
LLR    1.61 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 112678 W: 27154 L: 26842 D: 58682
PENTA  [326, 13495, 28434, 13709, 375]
Schoenemann Jochen
feature/manual-sub-add-all
collaps both loops present in subAll() and addAll() into one loop and add manual simd
diff8.0+0.08
ELO    0.56 +- 7.11 (95%)
LLR    0.44 (-2.94, 2.94) [-5.00, 0.00]
GAMES  N: 3088 W: 801 L: 796 D: 1491
PENTA  [37, 373, 714, 388, 32]
Caissa Witek
corrhist-recorrect-eval
diff10.0+0.10
ELO    0.72 +- 2.73 (95%)
LLR    0.11 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 16504 W: 3942 L: 3908 D: 8654
PENTA  [49, 1970, 4184, 1996, 53]
Erebus Jshriver
main
diffN=5000
ELO    -0.15 +- 0.61 (95%)
GAMES  N: 868414/5000000 W: 304392 L: 304779 D: 259243
Priority -1
Caissa Witek
tt-cutoff-value-damp
diff10.0+0.10
ELO    2.49 +- 6.39 (95%)
LLR    0.19 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 3072 W: 740 L: 718 D: 1614
PENTA  [8, 372, 754, 394, 8]
Priority -2
Caissa Witek
tt-halfmove-guard-margin
diff10.0+0.10
ELO    0.00 +- 0.00 (95%)
LLR    0.00 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 0 W: 0 L: 0 D: 0
PENTA  [0, 0, 0, 0, 0]
Caissa Witek
postlmr-hist-verify
diff10.0+0.10
ELO    0.00 +- 0.00 (95%)
LLR    0.00 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 0 W: 0 L: 0 D: 0
PENTA  [0, 0, 0, 0, 0]
Finished
Schoenemann Jochen
feature/lmr-ttpv-unsure
diff8.0+0.08
ELO    7.05 +- 4.62 (95%)
LLR    2.97 (-2.94, 2.94) [0.00, 5.00]
GAMES  N: 7594 W: 2027 L: 1873 D: 3694
PENTA  [73, 926, 1675, 1020, 103]
Caissa Witek
improving-or-eval-above-beta
diff60.0+0.60
ELO    1.40 +- 1.31 (95%)
LLR    2.98 (-2.94, 2.94) [-0.50, 2.50]
GAMES  N: 64246 W: 15213 L: 14955 D: 34078
PENTA  [39, 7323, 17133, 7597, 31]
Schoenemann Jochen
test/only-patched-history
Test only the patched history because I mixed two patches (this test should fail)
diff8.0+0.08
ELO    -4.23 +- 4.66 (95%)
LLR    -2.97 (-2.94, 2.94) [0.00, 5.00]
GAMES  N: 7396 W: 1825 L: 1915 D: 3656
PENTA  [99, 942, 1692, 880, 85]
Schoenemann Jochen
feature/lmr-history
forgot to push changes ahhhh
diff8.0+0.08
ELO    4.06 +- 3.10 (95%)
LLR    3.01 (-2.94, 2.94) [0.00, 5.00]
GAMES  N: 16000 W: 4201 L: 4014 D: 7785
PENTA  [158, 1898, 3738, 2011, 195]
Caissa Witek
tt-research-margin
diff10.0+0.10
ELO    -0.21 +- 0.99 (95%)
LLR    -2.95 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 126364 W: 30046 L: 30123 D: 66195
PENTA  [400, 15242, 31934, 15247, 359]
Caissa Witek
improving-or-eval-above-beta
diff10.0+0.10
ELO    4.22 +- 2.22 (95%)
LLR    2.97 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 25056 W: 6117 L: 5813 D: 13126
PENTA  [81, 2850, 6376, 3126, 95]
Schoenemann Jochen
feature/minor-history
adjust values (reduce the weight of the pawn corr hist)
diff8.0+0.08
ELO    -2.28 +- 3.75 (95%)
LLR    -2.96 (-2.94, 2.94) [0.00, 5.00]
GAMES  N: 11124 W: 2805 L: 2878 D: 5441
PENTA  [127, 1400, 2586, 1317, 132]
Caissa Witek
value-aware-threat-bits
diff10.0+0.10
ELO    -11.92 +- 4.09 (95%)
LLR    -2.95 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 7406 W: 1673 L: 1927 D: 3806
PENTA  [34, 997, 1882, 769, 21]
Caissa Witek
capt-hist-contrast-guard
diff10.0+0.10
ELO    -1.38 +- 1.60 (95%)
LLR    -2.96 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 48524 W: 11527 L: 11720 D: 25277
PENTA  [148, 5961, 12244, 5754, 155]
Caissa Witek
prior-cmh-failhigh-malus
diff10.0+0.10
ELO    -86.62 +- 12.09 (95%)
LLR    -1.75 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 872 W: 124 L: 337 D: 411
PENTA  [13, 222, 167, 33, 1]
Caissa Witek
root-partial-best-move
diffN=25000
ELO    12.86 +- 4.53 (95%)
LLR    2.95 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 9512 W: 2947 L: 2595 D: 3970
PENTA  [201, 990, 2059, 1268, 238]
Schoenemann Jochen
feature/minor-history
diff8.0+0.08
ELO    -1.40 +- 3.30 (95%)
LLR    -3.00 (-2.94, 2.94) [0.00, 5.00]
GAMES  N: 14918 W: 3843 L: 3903 D: 7172
PENTA  [185, 1893, 3379, 1801, 201]
Schoenemann Jochen
feature/major-history
Try adjusted values
diff8.0+0.08
ELO    4.22 +- 3.23 (95%)
LLR    3.00 (-2.94, 2.94) [0.00, 5.00]
GAMES  N: 15886 W: 4303 L: 4110 D: 7473
PENTA  [214, 1868, 3603, 2027, 231]
Quanticade DarkNeutrino
fp-correction
search.c: Correction margin to futility pruning
diff60.0+0.60
ELO    -0.15 +- 1.44 (95%)
LLR    -2.26 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 50260 W: 11446 L: 11467 D: 27347
PENTA  [10, 5583, 13972, 5548, 17]
Schoenemann Jochen
feature/major-history
fixed typo (normalize final correction correctly so that the ration between pawn and major is 3:1)
diff8.0+0.08
ELO    -0.59 +- 2.78 (95%)
LLR    -3.00 (-2.94, 2.94) [0.00, 5.00]
GAMES  N: 20748 W: 5201 L: 5236 D: 10311
PENTA  [252, 2586, 4752, 2513, 271]