FuryBench Testing Framework

home toIntegralPlentyChessObsidianCaissaQuanticadeSerendipitySpaghetSchoenemannClarityIlluminaPawnocchioVineAnura
Active : 14 Machines / 159 Threads / 118.82 MNPS
Priority 0
Caissa Witek
eval-ml-8-152B-spsa
New neural net (eval-ml-8-152B) LTC: ELO 7.32 +- 3.54 (95%) SPRT 60.0+0.60s Threads=1 Hash=128MB LLR 2.98 (-2.94, 2.94) [0.00, 3.00] GAMES N: 9072 W: 2217 L: 2026 D: 4829 PENTA [8, 990, 2348, 1183, 7] https://furybench.com/test/7428/ STC: ELO 1.58 +- 1.19 (95%) SPRT 10.0+0.10s Threads=1 Hash=16MB LLR 3.01 (-2.94, 2.94) [0.00, 2.00] GAMES N: 91412 W: 22159 L: 21744 D: 47509 PENTA [420, 10869, 22705, 11300, 412] https://furybench.com/test/7427/ 25k fixed nodes (local test): Elo: 22.73 +/- 5.65, nElo: 33.53 +/- 8.31 LOS: 100.00 %, DrawRatio: 41.37 %, PairsRatio: 1.41 Games: 6720, Wins: 2292, Losses: 1853, Draws: 2575, Points: 3579.5 (53.27 %) Ptnml(0-2): [141, 678, 1390, 903, 248], WL/DD Ratio: 1.80
diff40.0+0.40
ELO    5.97 +- 3.57 (95%)
LLR    2.34 (-2.94, 2.94) [0.00, 3.00]
GAMES  N: 8908 W: 2173 L: 2020 D: 4715
PENTA  [10, 967, 2353, 1108, 16]
Quanticade DarkNeutrino
noisy-triple
diff60.0+0.60
ELO    -1.24 +- 3.24 (95%)
LLR    -1.01 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 9822 W: 2278 L: 2313 D: 5231
PENTA  [2, 1103, 2735, 1070, 1]
Quanticade DarkNeutrino
pv-triple
diff60.0+0.60
ELO    -2.10 +- 2.96 (95%)
LLR    -1.72 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 11562 W: 2633 L: 2703 D: 6226
PENTA  [1, 1296, 3258, 1224, 2]
Priority -1
Quanticade DarkNeutrino
master
25K node datagen.
diffN=25000
ELO    -0.11 +- 0.15 (95%)
GAMES  N: 14708050/30000000 W: 5159429 L: 5164060 D: 4384561
Quanticade DarkNeutrino
hse-tuned
crash smp diff20.0+0.20
ELO    -0.15 +- 3.19 (95%)
LLR    -0.43 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 9582 W: 2191 L: 2195 D: 5196
PENTA  [3, 1001, 2785, 1001, 1]
Finished
Caissa Witek
eval-ml-8-152B-spsa
New neural net (eval-ml-8-152B) LTC: ELO 7.32 +- 3.54 (95%) SPRT 60.0+0.60s Threads=1 Hash=128MB LLR 2.98 (-2.94, 2.94) [0.00, 3.00] GAMES N: 9072 W: 2217 L: 2026 D: 4829 PENTA [8, 990, 2348, 1183, 7] https://furybench.com/test/7428/ STC: ELO 1.58 +- 1.19 (95%) SPRT 10.0+0.10s Threads=1 Hash=16MB LLR 3.01 (-2.94, 2.94) [0.00, 2.00] GAMES N: 91412 W: 22159 L: 21744 D: 47509 PENTA [420, 10869, 22705, 11300, 412] https://furybench.com/test/7427/ 25k fixed nodes (local test): Elo: 22.73 +/- 5.65, nElo: 33.53 +/- 8.31 LOS: 100.00 %, DrawRatio: 41.37 %, PairsRatio: 1.41 Games: 6720, Wins: 2292, Losses: 1853, Draws: 2575, Points: 3579.5 (53.27 %) Ptnml(0-2): [141, 678, 1390, 903, 248], WL/DD Ratio: 1.80
diff8.0+0.08
ELO    5.97 +- 2.73 (95%)
LLR    2.95 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 17164 W: 4182 L: 3887 D: 9095
PENTA  [67, 1926, 4330, 2163, 96]
Integral Fury
se_margin_history
diff40.0+0.40
ELO    4.04 +- 2.52 (95%)
LLR    2.89 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 16866 W: 4196 L: 4000 D: 8670
PENTA  [21, 1760, 4680, 1946, 26]
Caissa Witek
spsa-l3-tunables
diff6.0+0.06
TUNE   231 parameters
ITER   6,769 / 20,000
GAMES  108,304 / 320,000
Caissa Witek
net_1536
Neural net: Increase accumulator size to 1536
diff20.0+0.10
ELO    1.19 +- 1.95 (95%)
LLR    0.68 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 26918 W: 6776 L: 6684 D: 13458
PENTA  [9, 2900, 7548, 2994, 8]
Integral Fury
se_margin_history
diff10.0+0.10
ELO    2.12 +- 1.65 (95%)
LLR    2.90 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 42382 W: 10622 L: 10363 D: 21397
PENTA  [72, 4836, 11133, 5061, 89]
Caissa Witek
net_1536
Neural net: Increase accumulator size to 1536
diff10.0+0.10
ELO    1.58 +- 1.19 (95%)
LLR    3.01 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 91412 W: 22159 L: 21744 D: 47509
PENTA  [420, 10869, 22705, 11300, 412]
Integral Fury
failed_pc_lmr
diff10.0+0.10
ELO    -1.16 +- 2.54 (95%)
LLR    -1.71 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 17976 W: 4414 L: 4474 D: 9088
PENTA  [35, 2113, 4768, 2021, 51]
Caissa Witek
net_1536
Neural net: Increase accumulator size to 1536
diff60.0+0.60
ELO    7.32 +- 3.54 (95%)
LLR    2.98 (-2.94, 2.94) [0.00, 3.00]
GAMES  N: 9072 W: 2217 L: 2026 D: 4829
PENTA  [8, 990, 2348, 1183, 7]
Integral Fury
failed_pc_lmr
diff10.0+0.10
ELO    0.00 +- 0.00 (95%)
LLR    0.00 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 0 W: 0 L: 0 D: 0
PENTA  [0, 0, 0, 0, 0]
Quanticade DarkNeutrino
se-bs
search.c: capture for SE and pv for triple extensions margins
diff10.0+0.10
ELO    -24.49 +- 22.48 (95%)
LLR    -0.31 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 270 W: 55 L: 74 D: 141
PENTA  [3, 39, 68, 24, 1]
Integral Fury
inc_nmp_base_red
diff10.0+0.10
ELO    -1.72 +- 2.54 (95%)
LLR    -2.26 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 18570 W: 4632 L: 4724 D: 9214
PENTA  [49, 2235, 4815, 2131, 55]
Integral Fury
funky_nmp_tt_idea
diff10.0+0.10
ELO    -10.34 +- 5.37 (95%)
LLR    -2.27 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 4202 W: 974 L: 1099 D: 2129
PENTA  [12, 570, 1057, 455, 7]
PlentyChess Yoshie2000
0190r
Refactor + Speedup accumulator updates (#490)
diff8.0+0.08
ELO    -1.80 +- 2.31 (95%)
LLR    -2.28 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 23372 W: 5776 L: 5897 D: 11699
PENTA  [83, 2896, 5830, 2813, 64]
PlentyChess Yoshie2000
0190r
Refactor + Speedup accumulator updates (#490)
diff40.0+0.40
ELO    -5.94 +- 3.67 (95%)
LLR    -2.26 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 8072 W: 1926 L: 2064 D: 4082
PENTA  [5, 1000, 2161, 868, 2]
Caissa Witek
master
Prog test
diff10.0+0.10
ELO    24.71 +- 1.82 (95%)
GAMES  N: 40000/40000 W: 11179 L: 8339 D: 20482
PENTA  [188, 3586, 9680, 6290, 256]