Here is the number that should hang over every backtest review: run 100 strategies with zero skill on one year of daily data, and the best of them will show an annualized Sharpe ratio of roughly 2.5 — by pure luck. Not occasionally; in expectation. The deflated Sharpe ratio (DSR), from Bailey and López de Prado, is the tool that turns this fact into a hurdle: given how many things you tried, how good would your best result look if nothing worked? Beat that, or you’ve measured your own persistence.

It is the quantitative sequel to statistical vs economic significance: that guide says count your trials; this one says what the count costs you.

Step 1: a measured Sharpe is a noisy estimate

An estimated Sharpe ratio has sampling error like any statistic. For roughly i.i.d. returns, the standard error of an annualized Sharpe estimated from one year of daily data is about 1.0 — a true-zero strategy will regularly print ±1 over a year. Three practical consequences before any multiple-testing correction: short track records say almost nothing; negative skew and fat tails (which trading strategies produce chronically — selling vol manufactures smooth-then-cliff return profiles) inflate measured Sharpes’ reliability further; and the probabilistic Sharpe ratio (PSR) handles all of this by asking the right question — what is the probability the true Sharpe exceeds some benchmark, given the sample length, skew, and kurtosis of my returns?

The PSR formula (per-period units):

PSR = Φ( (SR − SR*) · √(T−1) / √(1 − γ₃·SR + ((γ₄−1)/4)·SR²) )

where T is sample length, γ₃ skewness, γ₄ kurtosis, and SR* the benchmark to beat. Negative skew and excess kurtosis shrink the denominator’s information content — exactly the penalty smooth-until-they’re-not strategies deserve.

Step 2: the maximum of N tries is not a fair draw

Now the multiple-testing half. If you evaluate N strategy variants and keep the best, you’ve sampled the maximum of N noisy Sharpes — and the expected maximum grows with N even when every true Sharpe is zero. Extreme-value theory gives the expected best-by-luck:

E[max SR] ≈ σ_SR · [ (1−γ)·Z(1 − 1/N) + γ·Z(1 − 1/(N·e)) ]

with γ ≈ 0.5772 (Euler–Mascheroni), Z the inverse normal CDF, and σ_SR the dispersion of Sharpe estimates across trials. The worked example behind this guide’s opening number: with one year of daily data, σ_SR ≈ 1.0 annualized, and N = 100 gives E[max SR] ≈ 1.0 × [0.4228·Z(0.99) + 0.5772·Z(0.99632)] ≈ 1.0 × (0.98 + 1.55) ≈ 2.5. The scaling is logarithmic — going from 100 to 1,000 trials only pushes the luck-ceiling toward ~3.25 — but almost nobody’s true trial count is small: every parameter grid cell, feature set, universe tweak, and abandoned variant counts, and so do respent holdouts.

Step 3: deflate

The DSR is simply the PSR evaluated against the luck-ceiling as the benchmark: SR* = E[max SR] for your N. It answers, in one probability: given my sample length, my return distribution’s tails, and how many things I tried, how likely is it that my best backtest reflects real skill rather than selection? A DSR near 1 survives; a spectacular raw Sharpe with a DSR near 0.5 is a coin flip wearing a tuxedo.

Using it honestly, without ceremony

  • Estimate N generously. Include the informal tries. If you can’t reconstruct it, use the grid you would have run — the estimate that flatters you is the wrong one. Correlated trials reduce the effective N (a formal treatment clusters trials by correlation); the honest shortcut is to count distinct strategy families at full weight.
  • Log trials as you go. An experiment log — one row per variant evaluated, part of the research-pipeline discipline — makes N a database query instead of an argument with yourself.
  • Apply it when reading, too. A paper reporting one golden configuration from an unstated search space earns an N in the hundreds by default; this is priced into our rigor scores, and it’s why single-configuration papers with no sensitivity analysis rank poorly across the factor and ML hubs.
  • See it, once. Ten minutes with our equity-curve simulator — run 100 zero-edge paths and look at the best one — teaches the maximum-of-N intuition more permanently than any formula.

The limits

DSR is a hurdle, not a verdict: it corrects selection within your recorded trials, not survivorship in your data, look-ahead in your pipeline, or costs you didn’t model — a leaked backtest deflates beautifully and is still fiction. It sits at the end of the evaluation chain, after the eight backtest questions, as the final filter on results that survived everything else.

References: Bailey & López de Prado, “The Deflated Sharpe Ratio” (2014); Harvey, Liu & Zhu on the cross-section of expected returns and the t ≈ 3 hurdle.

The discipline that feeds it: trial counting → · evaluate-once holdouts → · See luck’s distribution: equity-curve simulator → · Run your numbers: deflated Sharpe calculator →