Run a momentum backtest on the current S&P 500 membership back to 2000 and you will make money, because you have quietly required every company in the test to have survived until today. Enron, Lehman, and four hundred delisted small caps have been erased from history — along with the losses a real portfolio would have taken holding them. Survivorship bias is the most mechanical way a backtest lies, which makes it the first check in our backtest evaluation framework and a fixture in the papers that score poorly on empirical rigor.
The mechanism, precisely
The bias enters wherever a historical universe is constructed from a present-day list:
- Delisted securities vanish — and delisting is not random. Bankruptcies and failed listings exit with large negative final returns; using a survivors-only universe deletes exactly the left tail your strategy would have eaten.
- Index membership is applied retroactively — “S&P 500 stocks since 2000” using today’s membership tests only companies that grew into the index. Correct construction uses membership as of each date.
- Fund databases bury their dead — hedge fund and mutual fund datasets historically dropped closed funds; reported category averages are averages of the funds that didn’t blow up.
- Crypto has it worst: dead tokens, delisted pairs, and defunct exchanges disappear from APIs entirely, taking their price histories with them (our crypto hub is full of backtests that never met a dead exchange).
How big is it?
Magnitudes worth carrying in your head (long-run US equity estimates; direction generalizes, size varies):
- Long equity strategies on survivors-only data: roughly 1–4%/yr of phantom return, worst in small caps where delisting rates are highest.
- Strategies that select for distress — deep value, low price, high volatility — are distorted far more, because their picks are overrepresented among future delistings. A “buy losers” reversal backtest on survivors-only data is almost pure artifact.
- Hedge-fund index returns: the classic estimates put survivorship (plus backfill) inflation at 2–4%/yr — a large fraction of the headline “hedge fund premium.”
The asymmetry matters: the bias always flatters long exposure to the deleted tail, so it manufactures alpha for long strategies and can mask it for shorts.
The five-dead-tickers test
The fastest audit of any dataset, from our market-data guide: pick five well-known corpses — a bankruptcy (Lehman), an acquisition (Twitter), a delisted small cap, a dead SPAC, a failed token — and query their full histories. Three grades:
- Full history including final trading days → usable.
- History exists but ends months before the actual delisting → partial credit; final-period returns (often the worst ones) are missing.
- Ticker not found → the dataset is for dashboards, not research.
Run it before subscribing to any vendor and before trusting any public dataset. It takes ten minutes and settles what marketing pages never state.
Building a survivorship-clean backtest
- Universe as-of-date: reconstruct membership from historical constituent files or point-in-time listing status — the same PIT discipline that governs fundamentals.
- Include delisting returns: a position in a delisted stock must realize its final return — including the convention problem that final prices are sometimes missing (academic practice imputes substantial negative returns for performance-related delistings; whatever you choose, choose explicitly and disclose it).
- Source accordingly: CRSP is the academic gold standard precisely because of delisting coverage; among practitioner vendors, delisting depth is the sharpest quality divider — tiers and tests here.
- Archive forward: from today on, snapshot your own universe daily into your raw zone. Nobody can retroactively delete a survivor list you recorded yourself — the same “record your own books” logic as prediction markets.
Reading papers with this lens
When a paper doesn’t state its survivorship handling, the default assumption is contaminated — authors who did the work say so, because it’s expensive. Discount accordingly, and discount hardest for factor-investing results in small caps and “loser rebound” effects, where the bias concentrates. This is one of the checks behind the rigor axis on every paper page we publish.
Next in the bias family: Look-ahead bias & point-in-time data → · Test your vendor: market-data guide →