FuryBench Testing Framework

home toIntegralPlentyChessObsidianCaissaQuanticadeSerendipitySpaghetSchoenemannClarityIlluminaPawnocchioVineAnura
Active : 0 Machines / 0 Threads / 0 MNPS
Priority -1
Caissa Witek
eval-ml-11a-100B-spsa-transplant
diff60.0+0.60
ELO    0.56 +- 1.56 (95%)
LLR    0.16 (-2.94, 2.94) [-0.50, 2.50]
GAMES  N: 45058 W: 10444 L: 10372 D: 24242
PENTA  [33, 5153, 12076, 5243, 24]
Finished
Caissa Witek
allnode-razoring
diff10.0+0.10
ELO    -1.35 +- 1.58 (95%)
LLR    -2.96 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 49216 W: 11569 L: 11760 D: 25887
PENTA  [148, 6006, 12484, 5829, 141]
Caissa Witek
ph-2048
diff60.0+0.60
ELO    -0.95 +- 1.65 (95%)
LLR    -2.95 (-2.94, 2.94) [-0.50, 2.50]
GAMES  N: 40060 W: 9285 L: 9395 D: 21380
PENTA  [33, 4638, 10792, 4540, 27]
Caissa Witek
pawn-history
MoveOrderer: Pawn history
diff60.0+0.60
ELO    1.45 +- 1.35 (95%)
LLR    2.97 (-2.94, 2.94) [-0.50, 2.50]
GAMES  N: 60420 W: 14229 L: 13977 D: 32214
PENTA  [31, 6895, 16117, 7125, 42]
Caissa Witek
pawn-history
MoveOrderer: Pawn history
diff10.0+0.10
ELO    -0.38 +- 1.35 (95%)
LLR    -2.98 (-2.94, 2.94) [-0.50, 2.50]
GAMES  N: 68920 W: 16289 L: 16365 D: 36266
PENTA  [235, 8355, 17366, 8259, 245]
Caissa Witek
eval-ml-12-90B-permuted
diff10.0+0.10
ELO    -1.35 +- 1.60 (95%)
LLR    -2.95 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 49550 W: 11595 L: 11788 D: 26167
PENTA  [183, 6104, 12414, 5871, 203]
Caissa Witek
eval-ml-11a-100B-spsa-transplant
diff10.0+0.10
ELO    3.47 +- 2.00 (95%)
LLR    2.95 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 31480 W: 7633 L: 7319 D: 16528
PENTA  [124, 3617, 7934, 3951, 114]
Caissa Witek
eval-ml-11a-100B-permuted
frc diff10.0+0.10
ELO    2.34 +- 1.58 (95%)
LLR    2.98 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 53448 W: 12300 L: 11940 D: 29208
PENTA  [319, 6200, 13340, 6532, 333]
Caissa Witek
eval-ml-11a-100B-permuted
diff10.0+0.10
ELO    4.97 +- 2.44 (95%)
LLR    2.96 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 20694 W: 5008 L: 4712 D: 10974
PENTA  [62, 2347, 5249, 2611, 78]
Caissa Witek
eval-ml-10-125B-permuted
diff10.0+0.10
ELO    -11.04 +- 3.89 (95%)
LLR    -3.08 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 8468 W: 1833 L: 2102 D: 4533
PENTA  [42, 1156, 2092, 917, 27]
Caissa Witek
eval-ml-10-125B-permuted
diff10.0+0.10
ELO    -13.64 +- 4.34 (95%)
LLR    -2.98 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 6676 W: 1452 L: 1714 D: 3510
PENTA  [21, 957, 1646, 691, 23]
Caissa Witek
qs-conthist-fix
QSearch: Fix uninitialized cont history pointers
diff10.0+0.10
ELO    -0.30 +- 1.04 (95%)
LLR    -2.95 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 111836 W: 26171 L: 26268 D: 59397
PENTA  [309, 13345, 28702, 13258, 304]
Caissa Witek
root-sing-tweak
Time Manager: Tweak root singularity time fraction
diff60.0+0.60
ELO    0.05 +- 1.37 (95%)
LLR    -1.31 (-2.94, 2.94) [-0.50, 2.50]
GAMES  N: 58562 W: 13610 L: 13602 D: 31350
PENTA  [32, 6783, 15638, 6801, 27]
Caissa Witek
root-sing-tweak
Time Manager: Tweak root singularity time fraction
crash diff10.0+0.10
ELO    -0.19 +- 1.25 (95%)
LLR    -1.79 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 78518 W: 18686 L: 18730 D: 41102
PENTA  [251, 9444, 19954, 9318, 292]
Caissa Witek
root-complexity-tm
diff60.0+0.60
ELO    1.47 +- 1.68 (95%)
LLR    1.93 (-2.94, 2.94) [-0.50, 2.50]
GAMES  N: 37396 W: 8794 L: 8636 D: 19966
PENTA  [21, 4085, 10328, 4243, 21]
Caissa Witek
root-complexity-tm
diff10.0+0.10
ELO    2.96 +- 1.80 (95%)
LLR    2.97 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 37606 W: 9116 L: 8796 D: 19694
PENTA  [130, 4264, 9705, 4564, 140]
Caissa Witek
pairwise-rounding
Neural net: Use rounding to nearest in pairwise multiplication
diff10.0+0.10
ELO    0.36 +- 0.60 (95%)
LLR    -1.80 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 350884 W: 83636 L: 83274 D: 183974
PENTA  [1279, 41903, 88703, 42291, 1266]
Caissa Witek
eval-ml-8-dtm-b0-v2
Endgames: Remove KBNvK endgame evaluator KBNvK was preferred more than other, more winning endgame, leading to draws in winning positions. STC, KBNvK_dtz60.epd: Results of New vs Old (6+0.06, 1t, 8MB, KBNvK_dtz60.epd): Elo: 95.95 +/- 12.31, nElo: 234.36 +/- 28.57 LOS: 100.00 %, DrawRatio: 45.42 %, PairsRatio: 37.75 Games: 568, Wins: 164, Losses: 11, Draws: 393, Points: 360.5 (63.47 %) Ptnml(0-2): [0, 4, 129, 145, 6], WL/DD Ratio: 0.06 LLR: 2.95 (100.0%) (-2.94, 2.94) [0.00, 5.00] STC, endgames_cdb95105.epd: ELO 11.02 +- 3.49 (95%) SPRT 10.0+0.10s Threads=1 Hash=16MB LLR 3.00 (-2.94, 2.94) [0.00, 2.00] GAMES N: 7758 W: 1948 L: 1702 D: 4108 PENTA [2, 667, 2293, 917, 0] https://furybench.com/test/7502/
diff10.0+0.10
ELO    0.04 +- 0.71 (95%)
LLR    -2.98 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 195736 W: 46754 L: 46733 D: 102249
PENTA  [38, 20427, 56918, 20446, 39]
Caissa Witek
cont1-weight
diff10.0+0.10
ELO    -0.63 +- 1.25 (95%)
LLR    -2.96 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 81132 W: 19440 L: 19586 D: 42106
PENTA  [330, 9780, 20485, 9648, 323]
Caissa Witek
lmr-seen-index
diff10.0+0.10
ELO    -0.65 +- 1.27 (95%)
LLR    -2.95 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 79348 W: 18900 L: 19049 D: 41399
PENTA  [359, 9594, 19889, 9501, 331]
Caissa Witek
no-kbnvk
diff10.0+0.10
ELO    11.02 +- 3.49 (95%)
LLR    3.00 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 7758 W: 1948 L: 1702 D: 4108
PENTA  [2, 667, 2293, 917, 0]
Caissa Witek
qsearch-history-bonus
diff10.0+0.10
ELO    -0.09 +- 0.89 (95%)
LLR    -3.10 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 158698 W: 37704 L: 37746 D: 83248
PENTA  [553, 19088, 40140, 18984, 584]
Caissa Witek
conthist-summed-gravity
Search: Continuation history gravity uses summed scores
diff10.0+0.10
ELO    -13.41 +- 4.32 (95%)
LLR    -2.95 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 6634 W: 1459 L: 1715 D: 3460
PENTA  [30, 911, 1681, 675, 20]
Caissa Witek
corrhist-skip-endgame-eval
diff10.0+0.10
ELO    0.67 +- 1.01 (95%)
LLR    0.72 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 95532 W: 24240 L: 24057 D: 47235
PENTA  [25, 9828, 27865, 10035, 13]
Caissa Witek
eval-ml-9-106B-permuted.pnn
Search: Do not apply IIR in root nodes ELO 0.97 +- 1.40 (95%) SPRT 10.0+0.10s Threads=1 Hash=8MB LLR 2.96 (-2.94, 2.94) [-2.00, 0.00] GAMES N: 61664 W: 14724 L: 14552 D: 32388 PENTA [247, 7026, 16082, 7262, 215] https://furybench.com/test/7475/
diffN=25000
ELO    0.45 +- 1.47 (95%)
LLR    -0.48 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 92356 W: 27621 L: 27502 D: 37233
PENTA  [2181, 10899, 20013, 10790, 2295]
Caissa Witek
tt-cutoff-margin
diff10.0+0.10
ELO    1.35 +- 1.06 (95%)
LLR    2.95 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 112192 W: 26924 L: 26487 D: 58781
PENTA  [476, 13289, 28092, 13800, 439]