the GAUNTLET · Trials v1
PIERCINGVEIL.ai
report 2026-10-31T08:16:25+00:00
spec 565bfbfbdfe9650e
data bc97badf8e
Attempt · 565bfbfb
Surprise reversal: buy after robust return z<=-4 (30d), hold 5
FAILED AT TRIAL 2: EFFECT · did not survive the Gauntlet

Trials

TRIAL 1
Leakage PASS
next-open entry; trailing indicators; adjusted bars
bar: no lookahead
structural: indicators use bars <= decision bar; entry at the following open; verified by tests/test_leak.py
TRIAL 2
Effect FAIL
0.0115
bar: 0.03
out-of-sample information coefficient, sign-oriented, overlap-corrected
TRIAL 3
Costs FAIL
{
"sharpe_at_declared_costs": -0.199,
"sharpe_at_2x_costs": -0.249
}
bar: {"sharpe_at_declared_costs": 0.5, "sharpe_at_2x_costs": 0.0}
declared 20 bp round trip; must stay >= 0.5 and remain positive at 2x
TRIAL 4
Luck FAIL
{
"p_vs_luck": 1.0,
"q_storey_bh": 1.0,
"deflated_sharpe": 0.003,
"ideas_tried_declared": 36,
"history_runs": 14
}
bar: {"p_vs_luck": 0.05, "q_storey_bh": 0.1, "deflated_sharpe": 0.9}
matched-random and circular-shift nulls; FDR across the submitter's run history; Deflated Sharpe vs best-of-N worthless strategies
TRIAL 5
Tuning FAIL
{
"median_neighbour_sharpe_retention": 0.0,
"neighbours": 6,
"fraction_neighbours_better": 1.0,
"neighbour_sharpes": [
-0.147,
-0.196,
-0.031,
-0.154,
-0.124,
-0.034
]
}
bar: {"median_neighbour_sharpe_retention": 0.5}
every numeric parameter nudged +/-20%; a real edge degrades smoothly, a fitted one collapses
TRIAL 6
Stability FAIL
{
"fold_consistency": 0.417,
"drop_one_year_positive_fraction": 0.091,
"years": {
"2016": false,
"2017": false,
"2018": false,
"2019": false,
"2020": true,
"2021": false,
"2022": false,
"2023": false,
"2024": false,
"2025": false,
"2026": false
}
}
bar: {"fold_consistency": 0.6, "drop_one_year_positive_fraction": 0.8}
walk-forward folds must agree in sign; removing any single year must not flip the result
TRIAL 7
Evidence FAIL
{
"enough_evidence": 285,
"enough_independent_evidence": 155.0,
"not_one_episode": -0.014385,
"enough_episodes": 57,
"episode_consistency": 0.607
}
bar: {"enough_evidence": 250, "enough_independent_evidence": 60.0, "not_one_episode": 0.0, "enough_episodes": 15, "episode_consistency": 0.55}
observations, independent observations, episodes, not carried by one episode
TRIAL 8
Forward PENDING
pending
bar: 90 days live-forward agreement
cannot be passed at submission; badge turns fully green only after forward probation

SPY · 2016-01-04 → 2026-10-30

0.501.582.673.754.832016-01-042019-08-092023-03-162026-10-26
━ strategy┄ buy & hold
entriesdays in mkttotal retB&H retSharpeB&H Sharpemax DDICp luckp shiftDSR
39130-13.46%+342.77%-0.1770.878-26.92%0.02250.9360.9120.002
foldentriesSharpereturn
2016-01-04 → 2018-09-13110.219+2.39%
2018-09-14 → 2021-05-2817-0.644-19.15%
2021-06-01 → 2024-02-134-0.061-0.40%
2024-02-14 → 2026-10-3070.524+4.97%

QQQ · 2016-01-04 → 2026-10-30

0.352.244.136.027.912016-01-042019-08-092023-03-162026-10-26
━ strategy┄ buy & hold
entriesdays in mkttotal retB&H retSharpeB&H Sharpemax DDICp luckp shiftDSR
28105-9.38%+582.50%-0.0830.911-25.99%0.03550.8160.8050.007
foldentriesSharpereturn
2016-01-04 → 2018-09-1380.87+11.99%
2018-09-14 → 2021-05-2814-0.521-19.40%
2021-06-01 → 2024-02-1310.871+2.95%
2024-02-14 → 2026-10-305-0.214-2.48%

IWM · 2016-01-04 → 2026-10-30

0.551.241.932.623.312016-01-042019-08-092023-03-162026-10-26
━ strategy┄ buy & hold
entriesdays in mkttotal retB&H retSharpeB&H Sharpemax DDICp luckp shiftDSR
1450-25.00%+191.00%-0.3370.552-30.22%-0.02340.9981.0000.0
foldentriesSharpereturn
2016-01-04 → 2018-09-134-0.371-3.35%
2018-09-14 → 2021-05-287-0.546-17.87%
2021-06-01 → 2024-02-131-0.654-5.28%
2024-02-14 → 2026-10-3020.016-0.25%

Registered spec (hashed before testing)

{"costs_bps_round_trip":20.0,"direction":"long","entry":{"all":[{"ind":"ret_z","len":30,"op":"<=","value":-4}]},"exit":{"hold_bars":5},"ideas_tried":36,"kind":"rules","name":"Surprise reversal: buy after robust return z<=-4 (30d), hold 5","timeframe":"1Day","universe":["SPY","QQQ","IWM"]}