FuryBench Testing Framework

home toIntegralPlentyChessObsidianCaissaQuanticadeSerendipitySpaghetSchoenemannClarityIlluminaPawnocchioVineAnura
Active : 23 Machines / 480 Threads / 218.63 MNPS
Priority 0
Quanticade DarkNeutrino
tunable
SMP VLTC tune preparing for release time
smp diff20.0+0.20
TUNE   134 parameters
ITER   829 / 5,000
GAMES  3,316 / 20,000
Priority -1
Caissa Witek
legal-movegen
diff10.0+0.10
ELO    0.04 +- 1.80 (95%)
LLR    -0.86 (-2.94, 2.94) [-0.50, 2.50]
GAMES  N: 37360 W: 8904 L: 8900 D: 19556
PENTA  [125, 4396, 9613, 4442, 104]
Priority -10
Caissa Witek
master
NN: Output buckets split by queens on the board 16 output subnets instead of 8: piece count bucket * 2 + "any queen on the board". Net version 17. ELO 1.40 +- 1.08 (95%) SPRT 10.0+0.10s Threads=1 Hash=16MB LLR 3.01 (-2.94, 2.94) [0.00, 2.00] GAMES N: 106708 W: 25536 L: 25106 D: 56066 PENTA [401, 12544, 26993, 13056, 360] https://furybench.com/test/8043/ ELO 1.35 +- 1.28 (95%) SPRT 60.0+0.60s Threads=1 Hash=128MB LLR 2.95 (-2.94, 2.94) [-0.50, 2.50] GAMES N: 67256 W: 15894 L: 15633 D: 35729 PENTA [33, 7757, 17779, 8034, 25] https://furybench.com/test/8045/ Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
diff10.0+0.10
ELO    18.52 +- 5.25 (95%)
GAMES  N: 4770/40000 W: 1279 L: 1025 D: 2466
PENTA  [10, 494, 1146, 702, 33]
Finished
Caissa Witek
legal-movegen-2
diff8.0+0.08
ELO    -2.15 +- 2.33 (95%)
LLR    -2.95 (-2.94, 2.94) [-0.50, 2.50]
GAMES  N: 23160 W: 5482 L: 5625 D: 12053
PENTA  [94, 2835, 5864, 2694, 93]
Caissa Witek
see-quiet-threshold
SEE: Fix early exit for quiet moves with a positive threshold
diff8.0+0.08
ELO    0.70 +- 2.78 (95%)
LLR    0.62 (-2.94, 2.94) [-2.00, 0.00]
GAMES  N: 15944 W: 3824 L: 3792 D: 8328
PENTA  [64, 1858, 4082, 1918, 50]
Caissa Witek
legal-movegen
diffN=10000
ELO    2.18 +- 2.47 (95%)
LLR    1.32 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 39010 W: 12706 L: 12461 D: 13843
PENTA  [1396, 4229, 8064, 4366, 1450]
Caissa Witek
see-pinned-recapture
diffN=10000
ELO    10.32 +- 4.11 (95%)
LLR    3.13 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 14038 W: 4816 L: 4399 D: 4823
PENTA  [437, 1477, 2931, 1580, 594]
Caissa Witek
see-pinned-recapture
diff10.0+0.10
ELO    1.91 +- 1.37 (95%)
LLR    2.95 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 66182 W: 16070 L: 15707 D: 34405
PENTA  [205, 7811, 16716, 8134, 225]
Caissa Witek
history-piece-to-factorizer
diff10.0+0.10
ELO    -4.21 +- 3.09 (95%)
LLR    -1.95 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 12882 W: 3002 L: 3158 D: 6722
PENTA  [41, 1620, 3283, 1448, 49]
Quanticade DarkNeutrino
non-root-iir
search.c: Disable IIR in root node
diff10.0+0.10
ELO    -0.03 +- 1.10 (95%)
LLR    2.99 (-2.94, 2.94) [-3.00, 1.00]
GAMES  N: 96452 W: 22716 L: 22725 D: 51011
PENTA  [165, 11376, 25152, 11369, 164]
Caissa Witek
queen-output-buckets
NN: Output buckets split by queens on the board 16 output subnets instead of 8: piece count bucket * 2 + "any queen on the board". Net version 17. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
diff60.0+0.60
ELO    1.35 +- 1.28 (95%)
LLR    2.95 (-2.94, 2.94) [-0.50, 2.50]
GAMES  N: 67256 W: 15894 L: 15633 D: 35729
PENTA  [33, 7757, 17779, 8034, 25]
Clarity Vast
cm_2_new
new data mini net test before i kick off a full datagen run
diff8.0+0.08
ELO    -21.64 +- 8.47 (95%)
LLR    -2.27 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 2508 W: 594 L: 750 D: 1164
PENTA  [67, 344, 544, 276, 23]
Clarity Vast
cm_2_new
fixed nodes
diffN=20000
ELO    -31.78 +- 9.55 (95%)
LLR    -2.63 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 2138 W: 423 L: 618 D: 1097
PENTA  [62, 336, 438, 201, 32]
Caissa Witek
queen-output-buckets
NN: Output buckets split by queens on the board 16 output subnets instead of 8: piece count bucket * 2 + "any queen on the board". Net version 17. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
diff10.0+0.10
ELO    1.40 +- 1.08 (95%)
LLR    3.01 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 106708 W: 25536 L: 25106 D: 56066
PENTA  [401, 12544, 26993, 13056, 360]
Caissa Witek
tt-halfmove-guard-margin
diff10.0+0.10
ELO    -0.86 +- 1.33 (95%)
LLR    -2.96 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 65852 W: 15743 L: 15906 D: 34203
PENTA  [200, 7568, 17544, 7423, 191]
Caissa Witek
tt-cutoff-value-damp
diff10.0+0.10
ELO    -0.13 +- 0.93 (95%)
LLR    -2.98 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 142546 W: 33988 L: 34043 D: 74515
PENTA  [424, 17170, 36163, 17069, 447]
Caissa Witek
postlmr-hist-verify
diff10.0+0.10
ELO    -1.85 +- 1.77 (95%)
LLR    -2.98 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 39124 W: 9240 L: 9448 D: 20436
PENTA  [127, 4763, 9993, 4549, 130]
Caissa Witek
improving-default-true-nolmr
diff10.0+0.10
ELO    0.50 +- 0.47 (95%)
LLR    -0.20 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 554824 W: 132615 L: 131812 D: 290397
PENTA  [1607, 66378, 140717, 67025, 1685]