FuryBench Testing Framework

home toIntegralPlentyChessObsidianCaissaQuanticadeSerendipitySpaghetSchoenemannClarityIlluminaPawnocchioVineAnura
Finished
Integral Fury
pcd-sparse
diff10.0+0.10
ELO    2.00 +- 1.57 (95%)
LLR    2.94 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 48302 W: 12032 L: 11754 D: 24516
PENTA  [93, 5663, 12387, 5889, 119]
Illumina Mergener
better-hist-calc
diff8.0+0.08
ELO    15.68 +- 7.17 (95%)
LLR    2.90 (-2.25, 2.89) [0.00, 5.00]
GAMES  N: 2660 W: 642 L: 522 D: 1496
PENTA  [11, 275, 654, 363, 27]
Quanticade DarkNeutrino
master
25K node datagen.
diffN=25000
ELO    -0.08 +- 0.10 (95%)
GAMES  N: 30000010/30000000 W: 10528304 L: 10535074 D: 8936632
Integral Fury
pcd
diffN=25000
ELO    2.64 +- 2.03 (95%)
LLR    2.92 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 41400 W: 11732 L: 11418 D: 18250
PENTA  [624, 4925, 9335, 5145, 671]
Caissa Witek
root-complexity-tm
diff10.0+0.10
ELO    2.96 +- 1.80 (95%)
LLR    2.97 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 37606 W: 9116 L: 8796 D: 19694
PENTA  [130, 4264, 9705, 4564, 140]
Integral Fury
main
Bad Noisy Futility Pruning (#259)
diff40.0+0.40
ELO    32.48 +- 4.65 (95%)
GAMES  N: 5000/5000 W: 1443 L: 977 D: 2580
PENTA  [2, 367, 1302, 821, 8]
Integral Fury
bad_noisy_fp_attempt_1bajillion
diff10.0+0.10
ELO    2.12 +- 1.65 (95%)
LLR    2.92 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 43212 W: 10786 L: 10522 D: 21904
PENTA  [101, 4934, 11258, 5226, 87]
PlentyChess Yoshie2000
fix-one-singular
diff8.0+0.08
ELO    1.07 +- 1.92 (95%)
LLR    2.94 (-2.25, 2.89) [-3.00, 1.00]
GAMES  N: 26674 W: 6611 L: 6529 D: 13534
PENTA  [35, 2634, 7926, 2698, 44]
Integral Fury
zapdos
Update README
diff40.0+0.40
ELO    5.23 +- 3.32 (95%)
LLR    2.93 (-2.25, 2.89) [0.00, 4.00]
GAMES  N: 10290 W: 2616 L: 2461 D: 5213
PENTA  [15, 1116, 2733, 1261, 20]
Integral Fury
zapdos
Update README
diff10.0+0.10
ELO    6.13 +- 3.70 (95%)
LLR    2.90 (-2.25, 2.89) [0.00, 4.00]
GAMES  N: 8610 W: 2181 L: 2029 D: 4400
PENTA  [16, 954, 2216, 1100, 19]
Integral Fury
l1reg
Update README
diffN=20000
ELO    4.27 +- 2.87 (95%)
LLR    2.92 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 22152 W: 6508 L: 6236 D: 9408
PENTA  [373, 2636, 4869, 2742, 456]
Integral Fury
16kb_no_hmc
diff40.0+0.40
ELO    2.17 +- 1.64 (95%)
LLR    2.99 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 39946 W: 9956 L: 9706 D: 20284
PENTA  [24, 4418, 10838, 4670, 23]
Integral Fury
16kb_no_hmc
diff10.0+0.10
ELO    4.23 +- 2.65 (95%)
LLR    2.90 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 17076 W: 4258 L: 4050 D: 8768
PENTA  [37, 1948, 4366, 2144, 43]
Caissa Witek
no-kbnvk
diff10.0+0.10
ELO    11.02 +- 3.49 (95%)
LLR    3.00 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 7758 W: 1948 L: 1702 D: 4108
PENTA  [2, 667, 2293, 917, 0]
Integral Fury
16kb_no_hmc
diffN=25000
ELO    3.28 +- 2.40 (95%)
LLR    2.89 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 30086 W: 8695 L: 8411 D: 12980
PENTA  [484, 3503, 6818, 3721, 517]
Vine SwedishChef
rep_fix
Merge branch 'main' into rep_fix
diff40.0+0.40
ELO    6.36 +- 5.03 (95%)
LLR    2.91 (-2.25, 2.89) [-5.00, 0.00]
GAMES  N: 4646 W: 894 L: 809 D: 2943
PENTA  [14, 485, 1246, 558, 20]
Vine SwedishChef
dpbusd
proper inference
diff4.0+0.04
ELO    14.01 +- 6.63 (95%)
LLR    3.15 (-2.25, 2.89) [0.00, 5.00]
GAMES  N: 3498 W: 840 L: 699 D: 1959
PENTA  [35, 363, 820, 488, 43]
Vine SwedishChef
rep_fix
repetition detection fix
diff10.0+0.10
ELO    2.00 +- 3.46 (95%)
LLR    2.90 (-2.25, 2.89) [-5.00, 0.00]
GAMES  N: 11274 W: 2434 L: 2369 D: 6471
PENTA  [84, 1288, 2810, 1389, 66]
Integral Fury
tt_cutoff_shenanigans
diff10.0+0.10
ELO    2.46 +- 1.81 (95%)
LLR    2.99 (-2.25, 2.89) [0.00, 3.00]
GAMES  N: 35092 W: 8740 L: 8492 D: 17860
PENTA  [47, 4032, 9156, 4248, 63]
Caissa Witek
tt-cutoff-margin
diff10.0+0.10
ELO    1.35 +- 1.06 (95%)
LLR    2.95 (-2.94, 2.94) [0.00, 2.00]
GAMES  N: 112192 W: 26924 L: 26487 D: 58781
PENTA  [476, 13289, 28092, 13800, 439]
Caissa Witek
iir-no-root
diff10.0+0.10
ELO    0.97 +- 1.40 (95%)
LLR    2.96 (-2.94, 2.94) [-2.00, 0.00]
GAMES  N: 61664 W: 14724 L: 14552 D: 32388
PENTA  [247, 7026, 16082, 7262, 215]
Integral Fury
[Pawnocchio] dev
Add pawn-pawn pair network inputs (#254)
diff40.0+0.40
ELO    13.49 +- 3.29 (95%)
GAMES  N: 10000/10000 W: 2632 L: 2244 D: 5124
PENTA  [10, 945, 2699, 1339, 7]
Caissa Witek
opponent-worsening
diff60.0+0.60
ELO    1.89 +- 1.63 (95%)
LLR    2.97 (-2.94, 2.94) [-0.50, 2.50]
GAMES  N: 41594 W: 9781 L: 9555 D: 22258
PENTA  [37, 4689, 11106, 4941, 24]
Integral Fury
pawn_pair_inputs
diff40.0+0.40
ELO    7.22 +- 3.97 (95%)
LLR    2.91 (-2.25, 2.89) [0.00, 4.00]
GAMES  N: 6694 W: 1671 L: 1532 D: 3491
PENTA  [1, 688, 1832, 823, 3]
Integral Fury
pawn_pair_inputs
diff10.0+0.10
ELO    6.63 +- 3.86 (95%)
LLR    2.91 (-2.25, 2.89) [0.00, 4.00]
GAMES  N: 7856 W: 2019 L: 1869 D: 3968
PENTA  [23, 832, 2062, 994, 17]