Worked example: how much of a 1.50 Sharpe is luck after trying 229 variants?

The question Canli Validation answers is simple to ask and easy to get wrong: if you tried many versions of a strategy and kept the best one, how much of its Sharpe ratio is the search rather than skill?

A concrete case. A strategy shows a Sharpe ratio of 1.50, and on its own that looks like a 98.1% chance the edge is real. But it was the best of 229 variants. Among 229 variants with no skill at all, the best one is expected to reach a Sharpe of about 1.60 by luck alone. Once you account for the search, the chance that the 1.50 is real drops from 98.1% to 44.4%: closer to a coin flip than a discovery.

That is the deflated Sharpe ratio (Bailey and López de Prado). Give the tool the Sharpe, the number of variants you tried and how much their Sharpes differed, and it returns this number plus the minimum track record you'd need. Give it every variant's returns and it also estimates the probability of backtest overfitting (CSCV).

What it doesn't do: it prices the search, not the backtest itself. Costs, fills, look-ahead and survivorship inside your backtest are still on you.

Try it in the browser: https://canlicapital.com/tools/d... or from Claude/Cursor with: claude mcp add canli -- npx -y canli-validation-mcp

If you have a backtest you'd like a second look at, post the Sharpe, the number of variants and the length of the test here and I'll walk through what the numbers say.