Markets: A Rigorous Course

4.5 Statistics of the Sharpe ratio

Core about 20 min

Motivation

The Sharpe ratio is the number every allocator asks for, and the number every backtest is optimised to maximise. It is an estimate with a standard error that is usually much larger than people think. A three-year track record with an annualised Sharpe ratio of 1.0 is not statistically distinguishable from zero at the 5% level in a two-sided test, and only just passes a one-sided one.

4.5.1Setup#

Let r1,…,rTr_1,\dots,r_T be per-period excess returns (over the risk-free rate, or over a benchmark), stationary with mean μ\mu, variance σ2\sigma^2, third and fourth central moments μ3,μ4\mu_3,\mu_4, skewness γ3=μ3/σ3\gamma_3=\mu_3/\sigma^3 and (non-excess) kurtosis γ4=μ4/σ4\gamma_4=\mu_4/\sigma^4; a normal distribution has γ3=0\gamma_3=0, γ4=3\gamma_4=3. The per-period Sharpe ratio is S=μ/σS=\mu/\sigma, estimated by S^=μ^/σ^\hat S=\hat\mu/\hat\sigma. Throughout, SS and TT are in the same period (daily Sharpe with TT days). Annualise only at the end.

4.5.2The sampling distribution#

Proposition 4.11asymptotic distribution of S^\hat S

If rtr_t are iid with finite fourth moment,

T(S^−S)→dN(0,  v(S)),v(S)=1−γ3S+γ4−14S2,(4.11)\sqrt T(\hat S-S)\xrightarrow{d}N\big(0,\;v(S)\big),\qquad v(S)=1-\gamma_3S+\frac{\gamma_4-1}{4}S^2, \tag{4.11}

so that

SE⁡(S^)≈1−γ3S+γ4−14S2T.(4.12)\operatorname{SE}(\hat S)\approx\sqrt{\frac{1-\gamma_3S+\frac{\gamma_4-1}{4}S^2}{T}}. \tag{4.12}

For normal returns this is Lo's (2002) formula

SE⁡(S^)≈1+S2/2T.(4.13)\operatorname{SE}(\hat S)\approx\sqrt{\frac{1+S^2/2}{T}}. \tag{4.13}
Proof

Let θ=(μ,σ2)\theta=(\mu,\sigma^2) and θ^=(μ^,σ^2)\hat\theta=(\hat\mu,\hat\sigma^2). Write σ^2=1T∑(rt−μ)2−(μ^−μ)2\hat\sigma^2=\frac1T\sum(r_t-\mu)^2-(\hat\mu-\mu)^2; the second term is Op(1/T)O_p(1/T) and does not affect the T\sqrt T limit. By the multivariate CLT applied to the iid vectors (rt−μ,(rt−μ)2−σ2)(r_t-\mu,(r_t-\mu)^2-\sigma^2),

T(θ^−θ)→dN(0,Σ),Σ=(σ2μ3μ3μ4−σ4),\sqrt T(\hat\theta-\theta)\xrightarrow{d}N(0,\Sigma),\qquad \Sigma=\begin{pmatrix}\sigma^2&\mu_3\\ \mu_3&\mu_4-\sigma^4\end{pmatrix},

because Cov⁡(r−μ,(r−μ)2)=E(r−μ)3=μ3\operatorname{Cov}(r-\mu,(r-\mu)^2)=\mathbb E(r-\mu)^3=\mu_3 and Var⁡((r−μ)2)=μ4−σ4\operatorname{Var}((r-\mu)^2)=\mu_4-\sigma^4. The Sharpe ratio is g(θ)=μ/σ2g(\theta)=\mu/\sqrt{\sigma^2} with gradient ∇g=(1/σ,  −μ/(2σ3))\nabla g=\big(1/\sigma,\;-\mu/(2\sigma^3)\big). By the delta method the asymptotic variance is

∇g⊤Σ∇g=σ2σ2−2⋅1σ⋅μ2σ3μ3+μ24σ6(μ4−σ4)=1−Sγ3+S24(γ4−1).\nabla g^\top\Sigma\nabla g=\frac{\sigma^2}{\sigma^2}-2\cdot\frac1\sigma\cdot\frac{\mu}{2\sigma^3}\mu_3+\frac{\mu^2}{4\sigma^6}(\mu_4-\sigma^4)=1-S\gamma_3+\frac{S^2}{4}(\gamma_4-1).

With γ3=0\gamma_3=0, γ4=3\gamma_4=3 this is 1+S2/21+S^2/2.∎

The two non-normal terms have intuitive signs. Negative skew (γ3<0\gamma_3<0) with S>0S>0 increases the variance: option-selling strategies (M09) show smooth gains and rare large losses, and their Sharpe ratios are less reliable than they look. Fat tails (γ4>3\gamma_4>3) increase it further. For daily data SS is small (around 0.06 for an annual 1.0), so the correction terms are small and SE⁡≈1/T\operatorname{SE}\approx1/\sqrt T to a good approximation. The code checks (4.12) against Monte Carlo for normal and Student-tt returns.

Worked example 4.6how uncertain is a three-year Sharpe of 1.0?

A strategy on Nifty futures reports an annualised Sharpe ratio of 1.0 over three years of daily data. Per day, S^=1/252=0.0630\hat S=1/\sqrt{252}=0.0630 and T=756T=756. By (4.13), SE⁡=(1+0.00198)/756=0.0364\operatorname{SE}=\sqrt{(1+0.00198)/756}=0.0364 per day, which annualises to 0.0364252=0.5780.0364\sqrt{252}=0.578. The 95% interval for the annualised Sharpe ratio is 1.0±1.96×0.578=[−0.13, 2.13]1.0\pm1.96\times0.578=[-0.13,\,2.13], and the tt-statistic is 1.731.73. A three-year Sharpe of 1.0 does not reject zero in a two-sided 5% test. The one-sided test of H0:S≤0H_0:S\le0 used in 4.5.4 just rejects (PSR(0)=0.958\mathrm{PSR}(0)=0.958, and the MinTRL of 684 days is below 756), so the verdict hinges on a convention, which is itself the point: the evidence is marginal.

4.5.3Annualisation with autocorrelated returns#

Proposition 4.12Lo's annualisation

If per-period returns are stationary with autocorrelations ρk\rho_k, the Sharpe ratio of qq-period sums is

S(q)=η(q) S,η(q)=qq+2∑k=1q−1(q−k)ρk.(4.14)S(q)=\eta(q)\,S,\qquad\eta(q)=\frac{q}{\sqrt{q+2\sum_{k=1}^{q-1}(q-k)\rho_k}}. \tag{4.14}

With ρk=0\rho_k=0, η(q)=q\eta(q)=\sqrt q.

Proof

The qq-period sum has mean qμq\mu and variance ∑i,j=1qCov⁡(ri,rj)=σ2(q+2∑k=1q−1(q−k)ρk)\sum_{i,j=1}^{q}\operatorname{Cov}(r_i,r_j)=\sigma^2\big(q+2\sum_{k=1}^{q-1}(q-k)\rho_k\big), since lag kk appears in q−kq-k pairs on each side of the diagonal. Divide.∎

Positive autocorrelation, which smoothed or stale prices create (illiquid stocks, monthly NAVs, mark-to-model books), makes q\sqrt q scaling overstate the annual Sharpe ratio. With monthly data and ρ1=0.2\rho_1=0.2 only, η(12)=12/12+2⋅11⋅0.2=2.963\eta(12)=12/\sqrt{12+2\cdot11\cdot0.2}=2.963 against 12=3.464\sqrt{12}=3.464: the naive annualised Sharpe ratio is 17% too high.

4.5.4Probabilistic Sharpe ratio and minimum track record#

DefinitionPSR

Bailey and López de Prado (2012) define the probabilistic Sharpe ratio against a benchmark S∗S^* as

PSR(S∗)=Φ ⁣((S^−S∗)T−11−γ^3S^+γ^4−14S^2).(4.15)\mathrm{PSR}(S^*)=\Phi\!\left(\frac{(\hat S-S^*)\sqrt{T-1}}{\sqrt{1-\hat\gamma_3\hat S+\frac{\hat\gamma_4-1}{4}\hat S^2}}\right). \tag{4.15}

This is (4.11) used as a test: it is one minus the one-sided pp-value of H0:S≤S∗H_0:S\le S^*, with the variance evaluated at the estimates and T−1T-1 in place of TT. Reference value: S^=0.1\hat S=0.1, T=252T=252, normal moments, S∗=0S^*=0 gives Φ(0.1251/1.005)=Φ(1.5804)=0.942987\Phi(0.1\sqrt{251}/\sqrt{1.005})=\Phi(1.5804)=0.942987.

Minimum track record length Setting PSR(S∗)=1−α\mathrm{PSR}(S^*)=1-\alpha and solving for TT:

MinTRL=1+(1−γ^3S^+γ^4−14S^2)(z1−αS^−S∗)2.(4.16)\mathrm{MinTRL}=1+\Big(1-\hat\gamma_3\hat S+\frac{\hat\gamma_4-1}{4}\hat S^2\Big)\left(\frac{z_{1-\alpha}}{\hat S-S^*}\right)^2. \tag{4.16}

For an annual Sharpe ratio of 1.0 on daily data, S∗=0S^*=0 and 95% confidence (z=1.645z=1.645), MinTRL is 684 days (2.7 years) with normal returns, 730 days (2.9 years) with γ3=−1,γ4=8\gamma_3=-1,\gamma_4=8, and 778 days (3.1 years) with γ3=−2,γ4=15\gamma_3=-2,\gamma_4=15. Problem 4.9 asks you to derive (4.16).

Practitioner notes

Allocators who ask for a three-year track record are implicitly applying (4.16) with an annual Sharpe ratio near 1. A retail trader's six-month "track record" of a Sharpe of 2 is T=126T=126, S^=0.126\hat S=0.126, and PSR(0)=Φ(0.126125/1.008)≈0.92\mathrm{PSR}(0)=\Phi(0.126\sqrt{125}/\sqrt{1.008})\approx0.92: suggestive at best, before any account of how many traders with six-month records you are not hearing from. That is the subject of the next section.

Create a free account

Reading is open to everyone. An account keeps your progress, answers, notes and code drafts, and gives you the study plan, the journals and the simulator. Running code needs an account approved for it.