FuryBench Testing Framework

home toIntegralPlentyChessObsidianCaissaQuanticadeSerendipitySpaghetSchoenemannClarityIlluminaPawnocchioVineAnura
No logs for event exist
Active : 8 Machines / 111 Threads / 95.18 MNPS
Priority 0
Caissa Witek
eval-ml-8-152B-spsa
New neural net (eval-ml-8-152B) LTC: ELO 7.32 +- 3.54 (95%) SPRT 60.0+0.60s Threads=1 Hash=128MB LLR 2.98 (-2.94, 2.94) [0.00, 3.00] GAMES N: 9072 W: 2217 L: 2026 D: 4829 PENTA [8, 990, 2348, 1183, 7] https://furybench.com/test/7428/ STC: ELO 1.58 +- 1.19 (95%) SPRT 10.0+0.10s Threads=1 Hash=16MB LLR 3.01 (-2.94, 2.94) [0.00, 2.00] GAMES N: 91412 W: 22159 L: 21744 D: 47509 PENTA [420, 10869, 22705, 11300, 412] https://furybench.com/test/7427/ 25k fixed nodes (local test): Elo: 22.73 +/- 5.65, nElo: 33.53 +/- 8.31 LOS: 100.00 %, DrawRatio: 41.37 %, PairsRatio: 1.41 Games: 6720, Wins: 2292, Losses: 1853, Draws: 2575, Points: 3579.5 (53.27 %) Ptnml(0-2): [141, 678, 1390, 903, 248], WL/DD Ratio: 1.80
diff40.0+0.40
ELO    8.54 +- 5.53 (95%)
LLR    1.47 (-2.94, 2.94) [0.00, 3.00]
GAMES  N: 3786 W: 958 L: 865 D: 1963
PENTA  [4, 404, 991, 483, 11]
Quanticade DarkNeutrino
noisy-triple
diff60.0+0.60
ELO    -2.05 +- 3.48 (95%)
LLR    -1.23 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 8486 W: 1956 L: 2006 D: 4524
PENTA  [2, 957, 2374, 909, 1]
Quanticade DarkNeutrino
pv-triple
diff60.0+0.60
ELO    -1.83 +- 3.01 (95%)
LLR    -1.51 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 11222 W: 2568 L: 2627 D: 6027
PENTA  [1, 1256, 3157, 1195, 2]
Priority -1
Quanticade DarkNeutrino
master
25K node datagen.
diffN=25000
ELO    -0.11 +- 0.15 (95%)
GAMES  N: 14708050/30000000 W: 5159429 L: 5164060 D: 4384561
Quanticade DarkNeutrino
hse-tuned
crash smp diff20.0+0.20
ELO    -0.22 +- 3.20 (95%)
LLR    -0.47 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 9530 W: 2177 L: 2183 D: 5170
PENTA  [3, 998, 2767, 996, 1]
Finished
Caissa Witek
eval-ml-8-152B-spsa
New neural net (eval-ml-8-152B) LTC: ELO 7.32 +- 3.54 (95%) SPRT 60.0+0.60s Threads=1 Hash=128MB LLR 2.98 (-2.94, 2.94) [0.00, 3.00] GAMES N: 9072 W: 2217 L: 2026 D: 4829 PENTA [8, 990, 2348, 1183, 7] https://furybench.com/test/7428/ STC: ELO 1.58 +- 1.19 (95%) SPRT 10.0+0.10s Threads=1 Hash=16MB LLR 3.01 (-2.94, 2.94) [0.00, 2.00] GAMES N: 91412 W: 22159 L: 21744 D: 47509 PENTA [420, 10869, 22705, 11300, 412] https://furybench.com/test/7427/ 25k fixed nodes (local test): Elo: 22.73 +/- 5.65, nElo: 33.53 +/- 8.31 LOS: 100.00 %, DrawRatio: 41.37 %, PairsRatio: 1.41 Games: 6720, Wins: 2292, Losses: 1853, Draws: 2575, Points: 3579.5 (53.27 %) Ptnml(0-2): [141, 678, 1390, 903, 248], WL/DD Ratio: 1.80
diff8.0+0.08
ELO    5.97 +- 2.73 (95%)
LLR    2.95 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 17164 W: 4182 L: 3887 D: 9095
PENTA  [67, 1926, 4330, 2163, 96]
Integral Fury
se_margin_history
diff40.0+0.40
ELO    4.04 +- 2.52 (95%)
LLR    2.89 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 16866 W: 4196 L: 4000 D: 8670
PENTA  [21, 1760, 4680, 1946, 26]
Caissa Witek
spsa-l3-tunables
diff6.0+0.06
TUNE   231 parameters
ITER   6,769 / 20,000
GAMES  108,304 / 320,000
Caissa Witek
net_1536
Neural net: Increase accumulator size to 1536
diff20.0+0.10
ELO    1.19 +- 1.95 (95%)
LLR    0.68 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 26918 W: 6776 L: 6684 D: 13458
PENTA  [9, 2900, 7548, 2994, 8]
Integral Fury
se_margin_history
diff10.0+0.10
ELO    2.12 +- 1.65 (95%)
LLR    2.90 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 42382 W: 10622 L: 10363 D: 21397
PENTA  [72, 4836, 11133, 5061, 89]
Caissa Witek
net_1536
Neural net: Increase accumulator size to 1536
diff10.0+0.10
ELO    1.58 +- 1.19 (95%)
LLR    3.01 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 91412 W: 22159 L: 21744 D: 47509
PENTA  [420, 10869, 22705, 11300, 412]
Integral Fury
failed_pc_lmr
diff10.0+0.10
ELO    -1.16 +- 2.54 (95%)
LLR    -1.71 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 17976 W: 4414 L: 4474 D: 9088
PENTA  [35, 2113, 4768, 2021, 51]
Caissa Witek
net_1536
Neural net: Increase accumulator size to 1536
diff60.0+0.60
ELO    7.32 +- 3.54 (95%)
LLR    2.98 (-2.94, 2.94) [0.00, 3.00]
GAMES  N: 9072 W: 2217 L: 2026 D: 4829
PENTA  [8, 990, 2348, 1183, 7]
Integral Fury
failed_pc_lmr
diff10.0+0.10
ELO    0.00 +- 0.00 (95%)
LLR    0.00 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 0 W: 0 L: 0 D: 0
PENTA  [0, 0, 0, 0, 0]
Quanticade DarkNeutrino
se-bs
search.c: capture for SE and pv for triple extensions margins
diff10.0+0.10
ELO    -24.49 +- 22.48 (95%)
LLR    -0.31 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 270 W: 55 L: 74 D: 141
PENTA  [3, 39, 68, 24, 1]
Integral Fury
inc_nmp_base_red
diff10.0+0.10
ELO    -1.72 +- 2.54 (95%)
LLR    -2.26 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 18570 W: 4632 L: 4724 D: 9214
PENTA  [49, 2235, 4815, 2131, 55]
Integral Fury
funky_nmp_tt_idea
diff10.0+0.10
ELO    -10.34 +- 5.37 (95%)
LLR    -2.27 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 4202 W: 974 L: 1099 D: 2129
PENTA  [12, 570, 1057, 455, 7]
PlentyChess Yoshie2000
0190r
Refactor + Speedup accumulator updates (#490)
diff8.0+0.08
ELO    -1.80 +- 2.31 (95%)
LLR    -2.28 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 23372 W: 5776 L: 5897 D: 11699
PENTA  [83, 2896, 5830, 2813, 64]
PlentyChess Yoshie2000
0190r
Refactor + Speedup accumulator updates (#490)
diff40.0+0.40
ELO    -5.94 +- 3.67 (95%)
LLR    -2.26 (-2.25, 2.89) [0.00, 2.50]
GAMES  N: 8072 W: 1926 L: 2064 D: 4082
PENTA  [5, 1000, 2161, 868, 2]
Caissa Witek
master
Prog test
diff10.0+0.10
ELO    24.71 +- 1.82 (95%)
GAMES  N: 40000/40000 W: 11179 L: 8339 D: 20482
PENTA  [188, 3586, 9680, 6290, 256]