FuryBench Testing Framework

home toIntegralPlentyChessObsidianCaissaQuanticadeSerendipitySpaghetSchoenemannClarityIlluminaPawnocchioVineAnura
Finished
Caissa Witek
lmr_depth
diff10.0+0.10
ELO    1.75 +- 1.29 (95%)
LLR    2.95 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 75330 W: 17978 L: 17598 D: 39754
PENTA  [314, 8807, 19003, 9267, 274]
Caissa Witek
iir_no_pv
diff10.0+0.10
ELO    -1.68 +- 1.71 (95%)
LLR    -2.97 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 42144 W: 9722 L: 9926 D: 22496
PENTA  [157, 5118, 10692, 4982, 123]
Caissa Witek
rfp_correction
diff60.0+0.60
ELO    -0.65 +- 1.63 (95%)
LLR    -2.96 (-2.94, 2.94) [0.00, 3.00]
GAMES  N: 42048 W: 9408 L: 9487 D: 23153
PENTA  [26, 4990, 11064, 4925, 19]
Caissa Witek
rfp_improving_tweak
diff10.0+0.10
ELO    -2.98 +- 2.15 (95%)
LLR    -2.98 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 26366 W: 6077 L: 6303 D: 13986
PENTA  [93, 3227, 6746, 3047, 70]
Caissa Witek
rfp_correction
diff10.0+0.10
ELO    3.98 +- 2.15 (95%)
LLR    2.95 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 26300 W: 6313 L: 6012 D: 13975
PENTA  [68, 3015, 6693, 3296, 78]
Caissa Witek
simpl_se_root_depth
diff60.0+0.60
ELO    -1.55 +- 3.60 (95%)
LLR    -0.36 (-2.94, 2.94) [-3.00, 0.00]
GAMES  N: 8510 W: 1899 L: 1937 D: 4674
PENTA  [6, 1005, 2272, 965, 7]
Caissa Witek
devel
diff10.0+0.10
ELO    -0.00 +- 33.00 (95%)
GAMES  N: 108/100 W: 26 L: 26 D: 56
PENTA  [1, 10, 31, 12, 0]
Caissa Witek
eval-75-235B
diff60.0+0.60
ELO    2.79 +- 1.98 (95%)
LLR    2.96 (-2.94, 2.94) [0.00, 3.00]
GAMES  N: 28418 W: 6483 L: 6255 D: 15680
PENTA  [14, 3231, 7496, 3449, 19]
Caissa Witek
eval-75-235B
diff5.0+0.10
ELO    47.77 +- 1.77 (95%)
GAMES  N: 37638/40000 W: 12526 L: 7383 D: 17729
PENTA  [6, 2685, 8296, 7824, 8]
Caissa Witek
eval-75-235B
diff10.0+0.10
ELO    2.26 +- 4.44 (95%)
GAMES  N: 2764/40000 W: 486 L: 468 D: 1810
PENTA  [1, 148, 1067, 164, 2]
Caissa Witek
pc_cn
diff10.0+0.10
ELO    0.12 +- 0.87 (95%)
LLR    -2.07 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 164636 W: 38787 L: 38728 D: 87121
PENTA  [564, 19673, 41759, 19784, 538]
Caissa Witek
eval-75-235B
diff10.0+0.10
ELO    2.62 +- 1.68 (95%)
LLR    2.97 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 43944 W: 10539 L: 10208 D: 23197
PENTA  [131, 5135, 11132, 5420, 154]
Caissa Witek
simpl_se_root_depth
diff10.0+0.10
ELO    -1.98 +- 1.56 (95%)
LLR    -2.95 (-2.94, 2.94) [-3.00, 0.00]
GAMES  N: 49832 W: 11565 L: 11849 D: 26418
PENTA  [177, 5981, 12834, 5797, 127]
Caissa Witek
simpl_pvmove
diff8.0+0.08
ELO    0.13 +- 1.76 (95%)
LLR    2.96 (-2.94, 2.94) [-4.00, 0.00]
GAMES  N: 39628 W: 9503 L: 9488 D: 20637
PENTA  [140, 4685, 10163, 4672, 154]
Caissa Witek
lmr_noise
smp diff5.0+0.05
ELO    -0.81 +- 1.85 (95%)
LLR    -1.98 (-2.94, 2.94) [0.00, 2.50]
GAMES  N: 33212 W: 7721 L: 7798 D: 17693
PENTA  [52, 3897, 8790, 3810, 57]
Caissa Witek
tweak_hist_prun
diff10.0+0.10
ELO    -4.33 +- 2.57 (95%)
LLR    -2.95 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 19186 W: 4435 L: 4674 D: 10077
PENTA  [89, 2393, 4852, 2186, 73]
Caissa Witek
lmrscale_1024
diff10.0+0.10
ELO    2.45 +- 2.50 (95%)
LLR    2.98 (-2.94, 2.94) [-2.75, 0.25]
GAMES  N: 20122 W: 4861 L: 4719 D: 10542
PENTA  [69, 2373, 5048, 2489, 82]
Caissa Witek
datagen
diffN=40000
ELO    40.68 +- 5.93 (95%)
GAMES  N: 5002/20000 W: 1746 L: 1163 D: 2093
PENTA  [44, 424, 1078, 815, 140]
Caissa Witek
datagen_tuned_4
diffN=40000
ELO    3.56 +- 2.17 (95%)
LLR    2.95 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 37228 W: 10564 L: 10183 D: 16481
PENTA  [599, 4395, 8302, 4662, 656]
Caissa Witek
datagen_tuning
diffN=40000
TUNE   40 parameters
ITER   23,367 / 25,000
GAMES  747,764 / 800,000
Caissa Witek
eval-74-202B
diff10.0+0.10
ELO    -0.27 +- 1.37 (95%)
LLR    -1.66 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 66124 W: 15573 L: 15624 D: 34927
PENTA  [242, 7891, 16812, 7910, 207]
Caissa Witek
eval-73-254B
diff40.0+0.40
ELO    0.57 +- 1.05 (95%)
LLR    -0.19 (-2.94, 2.94) [0.00, 2.50]
GAMES  N: 100992 W: 22975 L: 22809 D: 55208
PENTA  [98, 11771, 26581, 11959, 87]
Caissa Witek
eval-73-254B
diff30.0+0.60
ELO    50.29 +- 9.34 (95%)
LLR    2.96 (-2.94, 2.94) [0.00, 3.00]
GAMES  N: 1294 W: 431 L: 245 D: 618
PENTA  [0, 83, 295, 269, 0]
Caissa Witek
eval-73-254B
diff5.0+0.10
ELO    48.39 +- 7.68 (95%)
LLR    3.00 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 2146 W: 705 L: 408 D: 1033
PENTA  [2, 165, 441, 464, 1]
Caissa Witek
eval-73-158B
diff10.0+0.10
ELO    0.79 +- 1.76 (95%)
LLR    0.35 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 39634 W: 9424 L: 9334 D: 20876
PENTA  [143, 4661, 10102, 4785, 126]