FuryBench Testing Framework

home toIntegralPlentyChessObsidianCaissaQuanticadeSerendipitySpaghetSchoenemannClarityIlluminaPawnocchioVineAnura
Finished
Caissa Witek
NN: Faster threat delta generation The bitboards a threat lookup needs (occupancy, victim masks per attacker type, and the piece code of every square as four bit planes) are computed once per position. Records are written through uint8_t, which may alias the position, so reading it directly reloaded its bitboards after every record. The changed squares come from the planes. Sliders are looked up only through squares whose occupancy changed: a square occupied in both positions stops the ray in both. speedup.py, MinGW bmi2 with eval-ti-2-120B-permuted embedded, depth 12, 20 rounds: 1,835,108 vs 1,814,096 nps, +1.173% [+0.640%, +1.706%]. No functional change. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
diff60.0+0.60
ELO    14.68 +- 5.22 (95%)
LLR    2.95 (-2.94, 2.94) [0.00, 3.00]
GAMES  N: 4310 W: 1126 L: 944 D: 2240
PENTA  [7, 426, 1112, 598, 12]
Caissa Witek
NN: Faster threat delta generation The bitboards a threat lookup needs (occupancy, victim masks per attacker type, and the piece code of every square as four bit planes) are computed once per position. Records are written through uint8_t, which may alias the position, so reading it directly reloaded its bitboards after every record. The changed squares come from the planes. Sliders are looked up only through squares whose occupancy changed: a square occupied in both positions stops the ray in both. speedup.py, MinGW bmi2 with eval-ti-2-120B-permuted embedded, depth 12, 20 rounds: 1,835,108 vs 1,814,096 nps, +1.173% [+0.640%, +1.706%]. No functional change. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
diff10.0+0.10
ELO    2.65 +- 1.71 (95%)
LLR    2.97 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 45312 W: 11222 L: 10877 D: 23213
PENTA  [241, 5355, 11096, 5746, 218]
Quanticade DarkNeutrino
net63 Just 1B more data
diffN=5000
ELO    7.06 +- 4.05 (95%)
LLR    3.10 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 15548 W: 5345 L: 5029 D: 5174
PENTA  [586, 1665, 3066, 1761, 696]
Integral Fury
Decay history malus by moves searched for all quiet histories (#271)
diff40.0+0.40
ELO    48.04 +- 3.28 (95%)
GAMES  N: 10000/10000 W: 3113 L: 1739 D: 5148
PENTA  [2, 584, 2480, 1906, 28]
Clarity Vast
progtest (bored)
diff8.0+0.08
ELO    14.96 +- 4.42 (95%)
GAMES  N: 7504/7500 W: 2000 L: 1677 D: 3827
PENTA  [76, 751, 1752, 1120, 53]
Caissa Witek
SEE: Fix early exit for quiet moves with a positive threshold
diff8.0+0.08
ELO    -0.00 +- 0.82 (95%)
LLR    2.98 (-2.94, 2.94) [-2.00, 0.00]
GAMES  N: 180428 W: 43368 L: 43369 D: 93691
PENTA  [656, 21261, 46380, 21262, 655]
Caissa WitekdiffN=10000
ELO    6.26 +- 3.18 (95%)
LLR    3.01 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 23490 W: 7860 L: 7437 D: 8193
PENTA  [829, 2435, 4846, 2754, 881]
Caissa Witekdiff10.0+0.10
ELO    7.42 +- 3.02 (95%)
LLR    2.95 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 13020 W: 3213 L: 2935 D: 6872
PENTA  [22, 1421, 3364, 1663, 40]
Caissa WitekdiffN=10000
ELO    10.32 +- 4.11 (95%)
LLR    3.13 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 14038 W: 4816 L: 4399 D: 4823
PENTA  [437, 1477, 2931, 1580, 594]
Caissa Witekdiff10.0+0.10
ELO    1.91 +- 1.37 (95%)
LLR    2.95 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 66182 W: 16070 L: 15707 D: 34405
PENTA  [205, 7811, 16716, 8134, 225]
Quanticade DarkNeutrino
search.c: Disable IIR in root node
diff10.0+0.10
ELO    -0.03 +- 1.10 (95%)
LLR    2.99 (-2.94, 2.94) [-3.00, 1.00]
GAMES  N: 96452 W: 22716 L: 22725 D: 51011
PENTA  [165, 11376, 25152, 11369, 164]
Caissa Witek
NN: Output buckets split by queens on the board 16 output subnets instead of 8: piece count bucket * 2 + "any queen on the board". Net version 17. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
diff60.0+0.60
ELO    1.35 +- 1.28 (95%)
LLR    2.95 (-2.94, 2.94) [-0.50, 2.50]
GAMES  N: 67256 W: 15894 L: 15633 D: 35729
PENTA  [33, 7757, 17779, 8034, 25]
Caissa Witek
NN: Output buckets split by queens on the board 16 output subnets instead of 8: piece count bucket * 2 + "any queen on the board". Net version 17. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
diff10.0+0.10
ELO    1.40 +- 1.08 (95%)
LLR    3.01 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 106708 W: 25536 L: 25106 D: 56066
PENTA  [401, 12544, 26993, 13056, 360]
PlentyChess Yoshie2000diff8.0+0.08
ELO    7.96 +- 3.49 (95%)
LLR    2.91 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 9696 W: 2514 L: 2292 D: 4890
PENTA  [17, 1048, 2509, 1244, 30]
PlentyChess Yoshie2000diffN=20000
ELO    19.02 +- 6.07 (95%)
LLR    2.91 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 4772 W: 1478 L: 1217 D: 2077
PENTA  [68, 473, 1078, 664, 103]
Caissa Witekdiff10.0+0.10
ELO    0.93 +- 0.74 (95%)
LLR    2.99 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 222062 W: 53326 L: 52730 D: 116006
PENTA  [706, 26303, 56391, 26951, 680]
Erebus JshriverdiffN=5000
ELO    0.15 +- 0.25 (95%)
GAMES  N: 5000006/5000000 W: 1752971 L: 1750857 D: 1496178
Schoenemann Jochendiff8.0+0.08
ELO    7.05 +- 4.62 (95%)
LLR    2.97 (-2.94, 2.94) [0.00, 5.00]
GAMES  N: 7594 W: 2027 L: 1873 D: 3694
PENTA  [73, 926, 1675, 1020, 103]
Caissa Witekdiff60.0+0.60
ELO    1.40 +- 1.31 (95%)
LLR    2.98 (-2.94, 2.94) [-0.50, 2.50]
GAMES  N: 64246 W: 15213 L: 14955 D: 34078
PENTA  [39, 7323, 17133, 7597, 31]
Schoenemann Jochen
forgot to push changes ahhhh
diff8.0+0.08
ELO    4.06 +- 3.10 (95%)
LLR    3.01 (-2.94, 2.94) [0.00, 5.00]
GAMES  N: 16000 W: 4201 L: 4014 D: 7785
PENTA  [158, 1898, 3738, 2011, 195]
Caissa Witekdiff10.0+0.10
ELO    4.22 +- 2.22 (95%)
LLR    2.97 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 25056 W: 6117 L: 5813 D: 13126
PENTA  [81, 2850, 6376, 3126, 95]
Caissa WitekdiffN=25000
ELO    12.86 +- 4.53 (95%)
LLR    2.95 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 9512 W: 2947 L: 2595 D: 3970
PENTA  [201, 990, 2059, 1268, 238]
Schoenemann Jochen
Try adjusted values
diff8.0+0.08
ELO    4.22 +- 3.23 (95%)
LLR    3.00 (-2.94, 2.94) [0.00, 5.00]
GAMES  N: 15886 W: 4303 L: 4110 D: 7473
PENTA  [214, 1868, 3603, 2027, 231]
Caissa Witeksmp diff5.0+0.05
ELO    5.46 +- 2.55 (95%)
LLR    2.98 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 18502 W: 4624 L: 4333 D: 9545
PENTA  [46, 2059, 4759, 2332, 55]
Caissa Witekdiff10.0+0.10
ELO    1.51 +- 1.15 (95%)
LLR    2.95 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 87868 W: 20973 L: 20591 D: 46304
PENTA  [232, 9850, 23386, 10236, 230]