VegaDeck

S&P 500

7,431.46+0.65%

NASDAQ 100

29,635.95+2.34%

DOW JONES

51,202.26+0.66%

EUR/USD

1.1567-0.06%

BTC/USD

63,496+0.16%

ETH/USD

1,663.8-0.33%

GBP/USD

1.34025-0.17%

SOL/USD

66.78-0.12%
Intermediate

Backtests and Overfitting Traps

In-sample glory, out-of-sample humility—why perfect curves lie.

4 Lessons8m total

Backtests replay rules on history. They do not automatically include microstructure change, fee evolution, regime shifts, or your future discipline unless you model them.

Start Course

Course Overview

In-sample glory, out-of-sample humility—why perfect curves lie.

What You'll Learn

Core concepts explained with market context
Practical examples tied to real instruments
Risk-aware framing — educational only
Next-step links across the VegaDeck curriculum

Backtests replay rules on history. They do not automatically include microstructure change, fee evolution, regime shifts, or your future discipline unless you model them.

Overfitting is tuning until the in-sample equity curve looks heroic. Indicators pile up; parameters multiply; filters proliferate. The model memorizes noise and calls it alpha.

Symptoms: performance collapses on a holdout period; small parameter changes destroy results; the rule set only works on one instrument or one decade; turnover is implausibly high after realistic costs.

Mitigations help but do not cure: simpler rules; pre-register hypotheses; walk-forward evaluation; true out-of-sample holds; stress tests on spreads and gaps; reporting drawdowns and tail days, not only CAGR screenshots.

Publishing research ethically means showing where the idea failed. VegaDeck does not rank or sell strategies in v1.x.

Educational only—not investment advice.

中文版:/academy/backtest-overfitting-zh

Educational only · not investment advice · Risk disclosures

Curriculum

4 Lessons · 32m
1Backtests and Overfitting TrapsIn-sample glory, out-of-sample humility—why perfect curves lie.8mContinue Learning
2Macro Scenario PlanningBase, bull, and bear paths without false precision.8m
3Regime Filters: Volatility and Trend StatesWhen to stand down — a research framing, not a signal.8m
4Strategy Hypothesis Checklist (Before You Backtest)Define the edge, failure modes, and data requirements—without selling signals.8m

Course Resources

Ready to take your trading to the next level?

Join readers who are advancing their skills with structured VegaDeck Academy lessons.

Start Learning Today

Educational only · not investment advice · Risk disclosures