FuryBench Testing Framework

home toIntegralPlentyChessObsidianCaissaQuanticadeSerendipitySpaghetSchoenemannClarityIlluminaPawnocchioVineAnura
Active : 12 Machines / 126 Threads / 85.58 MNPS
Priority 0
Caissa Witek
corrhist-skip-endgame-eval
diff10.0+0.10
ELO    0.69 +- 1.02 (95%)
LLR    0.78 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 93980 W: 23866 L: 23680 D: 46434
PENTA  [25, 9677, 27388, 9887, 13]
Integral Fury
tt_cutoff_shenanigans
diff10.0+0.10
ELO    2.45 +- 11.59 (95%)
LLR    0.07 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 850 W: 220 L: 214 D: 416
PENTA  [2, 94, 226, 102, 1]
Quanticade DarkNeutrino
master
25K node datagen.
diffN=25000
ELO    -0.10 +- 0.14 (95%)
GAMES  N: 16550660/30000000 W: 5806369 L: 5811188 D: 4933103
Caissa Witek
eval-ml-9-106B-permuted.pnn
Search: Do not apply IIR in root nodes ELO 0.97 +- 1.40 (95%) SPRT 10.0+0.10s Threads=1 Hash=8MB LLR 2.96 (-2.94, 2.94) [-2.00, 0.00] GAMES N: 61664 W: 14724 L: 14552 D: 32388 PENTA [247, 7026, 16082, 7262, 215] https://furybench.com/test/7475/
diffN=25000
ELO    -0.06 +- 1.53 (95%)
LLR    -1.54 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 84784 W: 25319 L: 25334 D: 34131
PENTA  [2020, 10039, 18353, 9896, 2084]
Priority -1
Caissa Witek
cont1-weight
diff10.0+0.10
ELO    0.33 +- 1.68 (95%)
LLR    -0.27 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 45052 W: 10943 L: 10900 D: 23209
PENTA  [191, 5381, 11344, 5414, 196]
Caissa Witek
lmr-seen-index
diff10.0+0.10
ELO    0.25 +- 1.72 (95%)
LLR    -0.38 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 44086 W: 10490 L: 10458 D: 23138
PENTA  [222, 5283, 10985, 5347, 206]
Caissa Witek
qs-conthist-fix
QSearch: Fix uninitialized cont history pointers
diff10.0+0.10
ELO    -0.08 +- 1.87 (95%)
LLR    -0.66 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 34130 W: 8005 L: 8013 D: 18112
PENTA  [89, 4059, 8774, 4057, 86]
Finished
Caissa Witek
tt-cutoff-margin
diff10.0+0.10
ELO    1.35 +- 1.06 (95%)
LLR    2.95 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 112192 W: 26924 L: 26487 D: 58781
PENTA  [476, 13289, 28092, 13800, 439]
Illumina Mergener
no-gives-check-condition-in-se
No check extensions during singular extensions
diff8.0+0.08
ELO    -0.03 +- 2.55 (95%)
LLR    -2.25 (-2.25, 2.89) [0.00, 5.00]
GAMES  N: 21266 W: 4682 L: 4684 D: 11900
PENTA  [156, 2553, 5206, 2573, 145]
Integral Fury
dynamic_complexity_lmr_again
diff10.0+0.10
ELO    -1.06 +- 2.12 (95%)
LLR    -2.26 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 24966 W: 6037 L: 6113 D: 12816
PENTA  [44, 2884, 6709, 2796, 50]
Integral Fury
fail_mid_multicut
diff10.0+0.10
ELO    -1.83 +- 2.54 (95%)
LLR    -2.26 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 17476 W: 4243 L: 4335 D: 8898
PENTA  [28, 2068, 4627, 1998, 17]
Caissa Witek
iir-no-root
diff10.0+0.10
ELO    0.97 +- 1.40 (95%)
LLR    2.96 (-2.94, 2.94) [-2.00, 0.00]
GAMES  N: 61664 W: 14724 L: 14552 D: 32388
PENTA  [247, 7026, 16082, 7262, 215]
Integral Fury
se_extend_complexity
diff10.0+0.10
ELO    -1.80 +- 2.55 (95%)
LLR    -2.25 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 17724 W: 4302 L: 4394 D: 9028
PENTA  [24, 2158, 4592, 2062, 26]
Illumina Mergener
complexity-reductions
Complexity LMR
diff8.0+0.08
ELO    -1.29 +- 3.54 (95%)
LLR    -2.27 (-2.25, 2.89) [0.00, 5.00]
GAMES  N: 11312 W: 2567 L: 2609 D: 6136
PENTA  [98, 1357, 2784, 1323, 94]
Integral Fury
tt_continuation_corrhist
diff10.0+0.10
ELO    -1.94 +- 2.77 (95%)
LLR    -2.03 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 15242 W: 3691 L: 3776 D: 7775
PENTA  [35, 1832, 3960, 1771, 23]
Integral Fury
eval_complexity_only_corrhist
diff10.0+0.10
ELO    -0.30 +- 1.50 (95%)
LLR    -2.29 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 42466 W: 10464 L: 10501 D: 21501
PENTA  [44, 4216, 12764, 4151, 58]
Integral Fury
eval_complexity_only_corrhist
diff10.0+0.10
ELO    -4.68 +- 3.49 (95%)
LLR    -2.28 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 7720 W: 1832 L: 1936 D: 3952
PENTA  [7, 809, 2330, 709, 5]
Caissa Witek
nmp-not-improving-margin
diff10.0+0.10
ELO    -1.56 +- 1.80 (95%)
LLR    -2.55 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 38224 W: 9003 L: 9175 D: 20046
PENTA  [130, 4656, 9728, 4452, 146]
Integral Fury
[Pawnocchio] dev
Add pawn-pawn pair network inputs (#254)
diff40.0+0.40
ELO    13.49 +- 3.29 (95%)
GAMES  N: 10000/10000 W: 2632 L: 2244 D: 5124
PENTA  [10, 945, 2699, 1339, 7]
Caissa Witek
rfp-margin-cap
diff10.0+0.10
ELO    -11.48 +- 4.01 (95%)
LLR    -2.98 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 7810 W: 1718 L: 1976 D: 4116
PENTA  [42, 1046, 1963, 836, 18]
Caissa Witek
opponent-worsening
diff60.0+0.60
ELO    1.89 +- 1.63 (95%)
LLR    2.97 (-2.94, 2.94) [-0.50, 2.50]
GAMES  N: 41594 W: 9781 L: 9555 D: 22258
PENTA  [37, 4689, 11106, 4941, 24]
Quanticade DarkNeutrino
se-correction
praying is becoming mandatory part of engine dev
diff60.0+0.60
ELO    1.13 +- 1.90 (95%)
LLR    0.64 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 28214 W: 6568 L: 6476 D: 15170
PENTA  [8, 3024, 7946, 3126, 3]