FuryBench Testing Framework

home toIntegralPlentyChessObsidianCaissaQuanticadeSerendipitySpaghetSchoenemannClarityIlluminaPawnocchioVineAnura
Finished
Illumina Mergener
v4-tune
V4 tune
diff40.0+0.40
ELO    4.52 +- 3.32 (95%)
LLR    2.89 (-2.25, 2.89) [0.00, 5.00]
GAMES  N: 11076 W: 2436 L: 2292 D: 6348
PENTA  [23, 1281, 2798, 1401, 35]
Illumina Mergener
main
diff40.0+0.40
TUNE   25 parameters
ITER   2,000 / 2,000
GAMES  32,000 / 32,000
Illumina Mergener
reorder-qsearch
Reorder qsearch
diff8.0+0.08
ELO    -0.12 +- 2.56 (95%)
LLR    -2.31 (-2.25, 2.89) [0.00, 5.00]
GAMES  N: 20526 W: 4488 L: 4495 D: 11543
PENTA  [142, 2451, 5055, 2502, 113]
Illumina Mergener
capture-pruning
Capture pruning
diff8.0+0.08
ELO    -4.24 +- 5.03 (95%)
LLR    -2.26 (-2.25, 2.89) [0.00, 5.00]
GAMES  N: 5240 W: 1134 L: 1198 D: 2908
PENTA  [29, 659, 1315, 581, 36]
Illumina Mergener
qsearch-tt-cutoff
QSearch TT cutoff
diff8.0+0.08
ELO    2.68 +- 2.17 (95%)
LLR    2.93 (-2.25, 2.89) [0.00, 5.00]
GAMES  N: 28880 W: 6400 L: 6177 D: 16303
PENTA  [171, 3425, 7051, 3596, 197]
Illumina Mergener
nmp-cutnode
Only do NMP when cut_node
diff8.0+0.08
ELO    -1.61 +- 3.68 (95%)
LLR    -2.26 (-2.25, 2.89) [0.00, 5.00]
GAMES  N: 9912 W: 2157 L: 2203 D: 5552
PENTA  [63, 1216, 2436, 1186, 55]
Illumina Mergener
shared-corrhist
Turns out non-pawn corrhist was broken and probably losing so let's test illu without it
diff8.0+0.08
ELO    -3.35 +- 4.63 (95%)
LLR    -2.30 (-2.25, 2.89) [0.00, 5.00]
GAMES  N: 6432 W: 1404 L: 1466 D: 3562
PENTA  [51, 802, 1553, 778, 32]
Illumina Mergener
shared-corrhist
This branch accidentally fixed a bug with non pawn corrhist and I need to check whether it gains
diff8.0+0.08
ELO    -4.73 +- 5.36 (95%)
LLR    -2.28 (-2.25, 2.89) [0.00, 5.00]
GAMES  N: 4998 W: 1120 L: 1188 D: 2690
PENTA  [54, 611, 1217, 583, 34]
Illumina Mergener
higher-rfp-depth
Higher RFP max depth
diff8.0+0.08
ELO    -4.21 +- 5.01 (95%)
LLR    -2.29 (-2.25, 2.89) [0.00, 5.00]
GAMES  N: 5364 W: 1206 L: 1271 D: 2887
PENTA  [36, 670, 1331, 613, 32]
Illumina Mergener
fix-increments
Tuned values
diff40.0+0.40
ELO    7.00 +- 4.40 (95%)
LLR    2.90 (-2.25, 2.89) [0.00, 5.00]
GAMES  N: 6202 W: 1371 L: 1246 D: 3585
PENTA  [7, 699, 1578, 796, 21]
Illumina Mergener
fix-increments
Tuned values
diff40.0+0.40
ELO    0.00 +- 0.00 (95%)
LLR    0.00 (-2.25, 2.89) [0.00, 5.00]
GAMES  N: 0 W: 0 L: 0 D: 0
PENTA  [0, 0, 0, 0, 0]
Illumina Mergener
fix-increments
diff40.0+0.40
TUNE   5 parameters
ITER   469 / 500
GAMES  7,516 / 8,000
Illumina Mergener
pawn-history
Butterfly pawn history
diff8.0+0.08
ELO    -0.72 +- 3.01 (95%)
LLR    -2.31 (-2.25, 2.89) [0.00, 5.00]
GAMES  N: 14474 W: 3091 L: 3121 D: 8262
PENTA  [77, 1755, 3595, 1741, 69]
Illumina Mergener
pawn-history
Butterfly pawn history
diff8.0+0.08
ELO    -1.18 +- 4.54 (95%)
LLR    -1.26 (-2.25, 2.89) [0.00, 5.00]
GAMES  N: 6490 W: 1408 L: 1430 D: 3652
PENTA  [37, 793, 1611, 763, 41]
Illumina Mergener
better-hist-calc
diff8.0+0.08
ELO    15.68 +- 7.17 (95%)
LLR    2.90 (-2.25, 2.89) [0.00, 5.00]
GAMES  N: 2660 W: 642 L: 522 D: 1496
PENTA  [11, 275, 654, 363, 27]
Illumina Mergener
qsearch-tt-pruning
Prune agressively during qsearch when a TT entry is found
diff8.0+0.08
ELO    -1.91 +- 3.89 (95%)
LLR    -2.26 (-2.25, 2.89) [0.00, 5.00]
GAMES  N: 9074 W: 1989 L: 2039 D: 5046
PENTA  [51, 1168, 2146, 1124, 48]
Illumina Mergener
killer-margin
Killer move margin
diff8.0+0.08
ELO    -16.72 +- 9.08 (95%)
LLR    -2.26 (-2.25, 2.89) [0.00, 5.00]
GAMES  N: 1622 W: 336 L: 414 D: 872
PENTA  [19, 209, 422, 153, 8]
Illumina Mergener
nmp-improving
Reduce further if "improving" in NMP
diff8.0+0.08
ELO    -1.15 +- 3.37 (95%)
LLR    -2.27 (-2.25, 2.89) [0.00, 5.00]
GAMES  N: 11782 W: 2619 L: 2658 D: 6505
PENTA  [77, 1420, 2922, 1409, 63]
Illumina Mergener
pawn-history
Fix compile error
diff8.0+0.08
ELO    -2.89 +- 4.44 (95%)
LLR    -2.26 (-2.25, 2.89) [0.00, 5.00]
GAMES  N: 6972 W: 1531 L: 1589 D: 3852
PENTA  [38, 896, 1688, 814, 50]
Illumina Mergener
remove-board-listener
Remove board listeners
diff8.0+0.08
ELO    1.59 +- 1.89 (95%)
LLR    0.71 (-2.25, 2.89) [0.00, 5.00]
GAMES  N: 37650 W: 8386 L: 8214 D: 21050
PENTA  [211, 4485, 9281, 4617, 231]
Illumina Mergener
no-gives-check-condition-in-se
No check extensions during singular extensions
diff8.0+0.08
ELO    -0.03 +- 2.55 (95%)
LLR    -2.25 (-2.25, 2.89) [0.00, 5.00]
GAMES  N: 21266 W: 4682 L: 4684 D: 11900
PENTA  [156, 2553, 5206, 2573, 145]
Illumina Mergener
complexity-reductions
Complexity LMR
diff8.0+0.08
ELO    -1.29 +- 3.54 (95%)
LLR    -2.27 (-2.25, 2.89) [0.00, 5.00]
GAMES  N: 11312 W: 2567 L: 2609 D: 6136
PENTA  [98, 1357, 2784, 1323, 94]
Illumina Mergener
complexity
Fix tunable bound
diff8.0+0.08
ELO    -77.71 +- 18.16 (95%)
LLR    -2.29 (-2.25, 2.89) [0.00, 5.00]
GAMES  N: 500 W: 68 L: 178 D: 254
PENTA  [14, 112, 97, 24, 3]
Illumina Mergener
remove-redundant-check
Remove redundant move legality check from qsearch
diff8.0+0.08
ELO    -0.25 +- 1.35 (95%)
LLR    1.91 (-2.25, 2.89) [-3.00, 0.00]
GAMES  N: 74090 W: 16373 L: 16426 D: 41291
PENTA  [474, 8891, 18343, 8888, 449]
Illumina Mergener
90-epochs
90 epochs net
diff8.0+0.08
ELO    4.17 +- 3.18 (95%)
LLR    2.91 (-2.25, 2.89) [0.00, 5.00]
GAMES  N: 13496 W: 3055 L: 2893 D: 7548
PENTA  [86, 1546, 3332, 1688, 96]