FuryBench Testing Framework

home toIntegralPlentyChessObsidianCaissaQuanticadeSerendipitySpaghetSchoenemannClarityIlluminaPawnocchioVineAnura
Finished
Clarity Vast
tune-concept
bored :þ
crash diff10.0+0.10
TUNE   56 parameters
ITER   505 / 10,000
GAMES  2,020 / 40,000
Clarity Vast
main
ltc core (pain)
diff40.0+0.40
ELO    25.96 +- 7.16 (95%)
GAMES  N: 2534/7500 W: 666 L: 477 D: 1391
PENTA  [12, 228, 591, 431, 5]
Clarity Vast
main
progtest because I'm bored and have spare hardware time
diff8.0+0.08
ELO    16.50 +- 7.76 (95%)
GAMES  N: 2466/10000 W: 655 L: 538 D: 1273
PENTA  [26, 237, 587, 360, 23]
Clarity Vast
bestmove
Take 2, trying to fix stale best moves
crash diff8.0+0.08
ELO    -0.29 +- 2.21 (95%)
LLR    0.41 (-2.25, 2.89) [-3.00, 1.00]
GAMES  N: 26674 W: 6075 L: 6097 D: 14502
PENTA  [143, 3157, 6775, 3103, 159]
Clarity Vast
bestmove
Get best move from PV table I expect null moves, which I'll fix later (hopefully later today)
crash diff8.0+0.08
ELO    4.35 +- 3.68 (95%)
LLR    2.95 (-2.25, 2.89) [-3.00, 1.00]
GAMES  N: 9754 W: 2332 L: 2210 D: 5212
PENTA  [55, 1104, 2444, 1212, 62]
Clarity Vast
tb-filtering
Trying it again with TBs, hopefully I can get some workers Issues to be fixed with clarity & fastchess (no SyzygyProbeLimit and bestmove doesnt match last pv)
diff8.0+0.08
ELO    -2.26 +- 2.51 (95%)
LLR    -2.27 (-2.25, 2.89) [-3.00, 1.00]
GAMES  N: 21546 W: 4874 L: 5014 D: 11658
PENTA  [201, 2459, 5541, 2423, 149]
Clarity Vast
tb-filtering
TB optimal move filtering at root. No elo but looks nice in tournaments :)
crash diff8.0+0.08
ELO    1.62 +- 2.40 (95%)
LLR    2.89 (-2.25, 2.89) [-3.00, 1.00]
GAMES  N: 20766 W: 4783 L: 4686 D: 11297
PENTA  [102, 2214, 5651, 2317, 99]
Clarity Vast
cn_032-ml
diff40.0+0.40
ELO    -8.62 +- 5.14 (95%)
LLR    -2.25 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 5238 W: 1185 L: 1315 D: 2738
PENTA  [42, 701, 1241, 615, 20]
Clarity Vast
cn_032-ml
diff8.0+0.08
ELO    -39.38 +- 10.98 (95%)
LLR    -2.32 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 1462 W: 283 L: 448 D: 731
PENTA  [35, 253, 296, 136, 11]
Clarity Vast
cn_032-ml
diff8.0+0.08
ELO    -119.48 +- 16.27 (95%)
LLR    -2.47 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 698 W: 76 L: 307 D: 315
PENTA  [43, 169, 113, 24, 0]
Clarity Vast
cn_032-ml
diff8.0+0.08
ELO    -110.80 +- 16.56 (95%)
LLR    -2.25 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 658 W: 73 L: 276 D: 309
PENTA  [37, 154, 113, 25, 0]
Clarity Vast
cn_032-ml
diffN=20000
ELO    26.03 +- 7.58 (95%)
LLR    3.14 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 3236 W: 870 L: 628 D: 1738
PENTA  [46, 317, 685, 489, 81]
Clarity Vast
is_legal
diff8.0+0.08
ELO    -1.04 +- 1.33 (95%)
LLR    -2.33 (-2.25, 2.89) [-3.00, 1.00]
GAMES  N: 75404 W: 17202 L: 17427 D: 40775
PENTA  [474, 9079, 18800, 8896, 453]
Clarity Vast
is_legal
crash diff8.0+0.08
ELO    -0.11 +- 1.58 (95%)
LLR    -2.26 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 53380 W: 12134 L: 12151 D: 29095
PENTA  [310, 6391, 13331, 6322, 336]
Clarity Vast
simd-refactor
diff8.0+0.08
ELO    0.45 +- 1.63 (95%)
LLR    2.91 (-2.25, 2.89) [-3.00, 1.00]
GAMES  N: 46952 W: 10714 L: 10653 D: 25585
PENTA  [267, 5222, 12441, 5275, 271]
Clarity Vast
restrict-stuff
diff8.0+0.08
ELO    1.20 +- 2.20 (95%)
LLR    2.92 (-2.25, 2.89) [-3.00, 1.00]
GAMES  N: 26916 W: 6228 L: 6135 D: 14553
PENTA  [178, 3033, 6920, 3172, 155]
Clarity Vast
simd-refactor
diff8.0+0.08
ELO    -4.18 +- 3.79 (95%)
LLR    -2.25 (-2.25, 2.89) [-10.00, 0.00]
GAMES  N: 7988 W: 1742 L: 1838 D: 4408
PENTA  [43, 877, 2236, 809, 29]
Clarity Vast
cn_032-10b
diff40.0+0.40
ELO    -0.91 +- 2.12 (95%)
LLR    -2.25 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 27998 W: 6471 L: 6544 D: 14983
PENTA  [104, 3447, 6956, 3402, 90]
Clarity Vast
cn_032-10b
diff8.0+0.08
ELO    -0.02 +- 1.58 (95%)
LLR    -2.26 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 58964 W: 14493 L: 14497 D: 29974
PENTA  [507, 7229, 14058, 7137, 551]
Clarity Vast
actually-do-fp
diff8.0+0.08
ELO    2.77 +- 2.05 (95%)
LLR    2.89 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 32146 W: 7453 L: 7197 D: 17496
PENTA  [175, 3834, 7827, 4034, 203]
Clarity Vast
actually-do-fp
diff40.0+0.40
ELO    0.54 +- 3.82 (95%)
LLR    -0.09 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 8352 W: 1862 L: 1849 D: 4641
PENTA  [26, 999, 2099, 1040, 12]
Clarity Vast
actually-do-fp
diff8.0+0.08
ELO    -8.95 +- 5.21 (95%)
LLR    -2.28 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 5162 W: 1114 L: 1247 D: 2801
PENTA  [49, 672, 1250, 583, 27]
Clarity Vast
actually-do-fp
diff8.0+0.08
ELO    -2.76 +- 3.23 (95%)
LLR    -2.35 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 15228 W: 3667 L: 3788 D: 7773
PENTA  [193, 1903, 3535, 1798, 185]
Clarity Vast
actually-do-fp
diff8.0+0.08
ELO    -3.01 +- 5.47 (95%)
LLR    -0.81 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 4624 W: 1023 L: 1063 D: 2538
PENTA  [37, 574, 1116, 562, 23]
Clarity Vast
cn_032-ft-2
diff40.0+0.40
ELO    -3.04 +- 3.16 (95%)
LLR    -2.27 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 12354 W: 2787 L: 2895 D: 6672
PENTA  [47, 1518, 3142, 1436, 34]