Markets: A Rigorous Course

14.13 Expected Shortfall and coherent risk measures

Core about 35 min

Motivation

14.8 set limits in terms of stress losses and drawdowns. A desk also needs one number that summarises the tail of the book's P&L distribution, can be aggregated across books, and does not reward hiding risk in the tail. Value-at-Risk (M02 · 2.8) fails the last two tests. Expected Shortfall passes them, and it is the measure Basel's Fundamental Review of the Trading Book adopted at 97.5% for bank market-risk capital.

14.13.1Definitions#

Setup

Work with the loss L=−P&LL = -\text{P\&L} of a position over a fixed horizon (one day, ten days), a random variable with finite mean. Write FLF_L for its distribution function and, for u∈(0,1)u \in (0,1), qu=inf⁡{ℓ:FL(ℓ)≥u}q_u = \inf\{\ell : F_L(\ell) \ge u\} for its lower uu-quantile. Fix a confidence level α∈(0,1)\alpha \in (0,1), typically 0.975 or 0.99.

Definition 14.1VaR and ES

VaR⁡α(L)=qα,ES⁡α(L)=11−α∫α1qu du.(14.10)\operatorname{VaR}_\alpha(L) = q_\alpha, \qquad \operatorname{ES}_\alpha(L) = \frac{1}{1-\alpha}\int_\alpha^1 q_u\,du. \tag{14.10}

This is the sign convention of M02 · 2.8 restated for losses: there, with return rr, VaRc=−q1−c(r)\text{VaR}_c = -q_{1-c}(r). ES is the average of the quantiles beyond α\alpha. When FLF_L is continuous, ES⁡α(L)=E[L∣L≥VaR⁡α(L)]\operatorname{ES}_\alpha(L) = \mathbb E[L \mid L \ge \operatorname{VaR}_\alpha(L)], which is the version in M02. When LL has atoms (option books, defaultable bonds, any discrete scenario set), the conditional-expectation version can fail to be subadditive, and (14.10) is the correct definition. Other names in the literature: CVaR, average VaR, tail VaR.

Definition 14.2coherence; Artzner, Delbaen, Eber and Heath 1999

A map ρ\rho from losses to R\mathbb R is a coherent risk measure if, for all losses L,L1,L2L, L_1, L_2:

  1. Monotonicity. L1≤L2L_1 \le L_2 almost surely implies ρ(L1)≤ρ(L2)\rho(L_1) \le \rho(L_2).
  2. Translation invariance. ρ(L+c)=ρ(L)+c\rho(L + c) = \rho(L) + c for constant cc. Adding ₹cc of certain loss adds ₹cc of risk.
  3. Positive homogeneity. ρ(λL)=λρ(L)\rho(\lambda L) = \lambda\rho(L) for λ≥0\lambda \ge 0.
  4. Subadditivity. ρ(L1+L2)≤ρ(L1)+ρ(L2)\rho(L_1 + L_2) \le \rho(L_1) + \rho(L_2).

Subadditivity is the axiom that matters for a desk. It says merging two books cannot create risk, so the sum of the desk-level numbers is a conservative bound for the firm, and limits allocated to desks add up. A measure that violates it can be gamed: split a book in two and report less risk.

14.13.2VaR is not subadditive#

VaR satisfies axioms 1–3 because quantiles are monotone and commute with increasing affine maps. It fails 4.

Proposition 14.18VaR is not subadditive

There exist independent L1,L2L_1, L_2 and α\alpha with VaR⁡α(L1+L2)>VaR⁡α(L1)+VaR⁡α(L2)\operatorname{VaR}_\alpha(L_1 + L_2) > \operatorname{VaR}_\alpha(L_1) + \operatorname{VaR}_\alpha(L_2).

Proofcounterexample

Two independent bonds each lose 100 with probability 0.04 and 0 otherwise. Take α=0.95\alpha = 0.95. For each bond FLi(0)=0.96≥0.95F_{L_i}(0) = 0.96 \ge 0.95, so VaR⁡0.95(Li)=0\operatorname{VaR}_{0.95}(L_i) = 0. For the sum, P(L1+L2=0)=0.962=0.9216<0.95P(L_1 + L_2 = 0) = 0.96^2 = 0.9216 < 0.95 and P(L1+L2≤100)=1−0.042=0.9984≥0.95P(L_1 + L_2 \le 100) = 1 - 0.04^2 = 0.9984 \ge 0.95, so VaR⁡0.95(L1+L2)=100>0+0\operatorname{VaR}_{0.95}(L_1 + L_2) = 100 > 0 + 0.∎

The trading version is the deep out-of-the-money short option: a position that loses a lot with probability below 1−α1-\alpha has a VaR equal to its usual small gain, with a negative sign. Two desks each selling such options report negative VaR; the firm holding both does not (Problem 14.18). VaR rewards exactly the negatively skewed exposure that M09 · 9.9 warns about. VaR is subadditive on linear portfolios of jointly elliptical returns (for example multivariate normal or multivariate tt), which is why delta-normal VaR rarely shows the problem; see McNeil, Frey and Embrechts, Quantitative Risk Management (rev. ed., 2015), ch. 8. Option books are not linear and returns are not elliptical in a crash.

In the bond example, the ES at 95% of each bond is the average of the top 5% of its quantiles: 4% of the mass at 100 and 1% at 0, so ES⁡=(0.04×100+0.01×0)/0.05=80\operatorname{ES} = (0.04 \times 100 + 0.01 \times 0)/0.05 = 80. For the sum, the top 5% contains the 0.16% atom at 200 and 4.84% of the 7.68% atom at 100: ES⁡=(0.0016×200+0.0484×100)/0.05=103.2≤160\operatorname{ES} = (0.0016 \times 200 + 0.0484 \times 100)/0.05 = 103.2 \le 160.

14.13.3ES is coherent#

Proposition 14.19Rockafellar–Uryasev representation

For any loss LL with E∣L∣<∞\mathbb E|L| < \infty,

ES⁡α(L)=min⁡c∈R{c+11−α E[(L−c)+]},(14.11)\operatorname{ES}_\alpha(L) = \min_{c \in \mathbb R}\Big\{c + \frac{1}{1-\alpha}\,\mathbb E\big[(L - c)^+\big]\Big\}, \tag{14.11}

and the minimum is attained at c=VaR⁡α(L)c = \operatorname{VaR}_\alpha(L).

Proof

If UU is uniform on (0,1)(0,1), then qUq_U has the distribution of LL, so E[(L−c)+]=∫01(qu−c)+ du\mathbb E[(L - c)^+] = \int_0^1 (q_u - c)^+\,du. Call the bracket in (14.11) f(c)f(c).

At c=qαc = q_\alpha: qu≤qαq_u \le q_\alpha for u<αu < \alpha and qu≥qαq_u \ge q_\alpha for u>αu > \alpha, because the quantile function is non-decreasing. Hence

f(qα)=qα+11−α∫α1(qu−qα) du=11−α∫α1qu du=ES⁡α(L).f(q_\alpha) = q_\alpha + \frac{1}{1-\alpha}\int_\alpha^1 (q_u - q_\alpha)\,du = \frac{1}{1-\alpha}\int_\alpha^1 q_u\,du = \operatorname{ES}_\alpha(L).

For any other cc, drop the non-negative integral over (0,α)(0,\alpha) and use x+≥xx^+ \ge x on (α,1)(\alpha,1):

f(c)≥c+11−α∫α1(qu−c) du=11−α∫α1qu du=ES⁡α(L).    ∎f(c) \ge c + \frac{1}{1-\alpha}\int_\alpha^1 (q_u - c)\,du = \frac{1}{1-\alpha}\int_\alpha^1 q_u\,du = \operatorname{ES}_\alpha(L). \;\;∎

Proposition 14.20Acerbi–Tasche 2002

ES⁡α\operatorname{ES}_\alpha is a coherent risk measure, and ES⁡α(L)≥VaR⁡α(L)\operatorname{ES}_\alpha(L) \ge \operatorname{VaR}_\alpha(L).

Proof

Monotonicity: L1≤L2L_1 \le L_2 a.s. implies (L1−c)+≤(L2−c)+(L_1 - c)^+ \le (L_2 - c)^+, so fL1(c)≤fL2(c)f_{L_1}(c) \le f_{L_2}(c) for every cc; take the minimum over cc. Translation invariance: fL+a(c+a)=fL(c)+af_{L+a}(c + a) = f_L(c) + a, and c↦c+ac \mapsto c + a is a bijection. Positive homogeneity: for λ>0\lambda > 0, fλL(λc)=λfL(c)f_{\lambda L}(\lambda c) = \lambda f_L(c); for λ=0\lambda = 0 both sides are 0.

Subadditivity: let ci=VaR⁡α(Li)c_i = \operatorname{VaR}_\alpha(L_i). Since (x+y)+≤x++y+(x + y)^+ \le x^+ + y^+,

ES⁡α(L1+L2)≤fL1+L2(c1+c2)=c1+c2+E[(L1−c1+L2−c2)+]1−α≤fL1(c1)+fL2(c2)=ES⁡α(L1)+ES⁡α(L2).\begin{aligned} \operatorname{ES}_\alpha(L_1 + L_2) &\le f_{L_1 + L_2}(c_1 + c_2) = c_1 + c_2 + \frac{\mathbb E[(L_1 - c_1 + L_2 - c_2)^+]}{1-\alpha} \\ &\le f_{L_1}(c_1) + f_{L_2}(c_2) = \operatorname{ES}_\alpha(L_1) + \operatorname{ES}_\alpha(L_2). \end{aligned}

No assumption on the dependence between L1L_1 and L2L_2 is used. Finally, ES⁡α\operatorname{ES}_\alpha averages qu≥qαq_u \ge q_\alpha over u∈(α,1)u \in (\alpha, 1).∎

Representation (14.11) is also the practical reason ES is used for optimisation: replacing E\mathbb E by an average over scenarios turns "minimise ES subject to a return target" into a linear programme in (c,w)(c, w) (Rockafellar and Uryasev 2000).

14.13.4ES under the Student-tt#

Proposition 14.21ES of the Student-tt

Let TνT_\nu have the standard Student-tt density gνg_\nu with ν>1\nu > 1 degrees of freedom, and let tα=Gν−1(α)t_\alpha = G_\nu^{-1}(\alpha) be its α\alpha-quantile. Then

ES⁡α(Tν)=gν(tα)1−α⋅ν+tα2ν−1.(14.12)\operatorname{ES}_\alpha(T_\nu) = \frac{g_\nu(t_\alpha)}{1-\alpha}\cdot\frac{\nu + t_\alpha^2}{\nu - 1}. \tag{14.12}

If the loss is L=μ+sTνL = \mu + sT_\nu with s=σ(ν−2)/νs = \sigma\sqrt{(\nu-2)/\nu} (so that sd⁡(L)=σ\operatorname{sd}(L) = \sigma, ν>2\nu > 2), then ES⁡α(L)=μ+sES⁡α(Tν)\operatorname{ES}_\alpha(L) = \mu + s\operatorname{ES}_\alpha(T_\nu).

Proof

gν(x)=cν(1+x2/ν)−(ν+1)/2g_\nu(x) = c_\nu(1 + x^2/\nu)^{-(\nu+1)/2}. Differentiate h(x)=(1+x2/ν)−(ν−1)/2h(x) = (1 + x^2/\nu)^{-(\nu-1)/2}:

h′(x)=−ν−12⋅2xν(1+x2ν)−(ν+1)/2=−ν−1ν⋅x gν(x)cν.h'(x) = -\frac{\nu-1}{2}\cdot\frac{2x}{\nu}\Big(1 + \frac{x^2}{\nu}\Big)^{-(\nu+1)/2} = -\frac{\nu-1}{\nu}\cdot\frac{x\,g_\nu(x)}{c_\nu}.

Hence, for ν>1\nu > 1 (so that h(x)→0h(x) \to 0 as x→∞x \to \infty),

∫t∞x gν(x) dx=νcνν−1 h(t)=νν−1(1+t2ν)gν(t)=gν(t) ν+t2ν−1.\int_{t}^\infty x\,g_\nu(x)\,dx = \frac{\nu c_\nu}{\nu - 1}\,h(t) = \frac{\nu}{\nu-1}\Big(1 + \frac{t^2}{\nu}\Big)g_\nu(t) = g_\nu(t)\,\frac{\nu + t^2}{\nu - 1}.

Divide by 1−α=P(Tν>tα)1 - \alpha = P(T_\nu > t_\alpha). The continuous case of (14.10) gives the conditional mean. ES commutes with increasing affine maps by translation invariance and positive homogeneity.∎

As ν→∞\nu \to \infty, (14.12) tends to ϕ(zα)/(1−α)\phi(z_\alpha)/(1-\alpha), the normal formula of M02 Proposition 2.14. A numerical integral reproduces (14.12): for ν=4\nu = 4, α=0.975\alpha = 0.975, both give 3.99356.

Worked example 14.13.1ES versus VaR at matched variance

Daily loss volatility σ=1.3%\sigma = 1.3\% of a ₹50 lakh Nifty position, μ=0\mu = 0.

Model VaR 97.5% VaR 99% ES 97.5% ES 99% ES 97.5% in ₹
Normal 2.548% 3.024% 3.039% 3.465% 1,51,957
Student-tt, ν=5\nu = 5 2.589% 3.388% 3.546% 4.484% 1,77,307
Student-tt, ν=4\nu = 4 2.552% 3.444% 3.671% 4.799% 1,83,552
Student-tt, ν=3\nu = 3 2.389% 3.408% 3.783% 5.256% 1,89,124

Two observations. First, for the normal, ES⁡0.975=2.338σ\operatorname{ES}_{0.975} = 2.338\sigma and VaR⁡0.99=2.326σ\operatorname{VaR}_{0.99} = 2.326\sigma: Basel's switch from 99% VaR to 97.5% ES leaves capital unchanged under normality and raises it exactly when tails are heavy. Second, at matched variance the 97.5% VaR barely depends on ν\nu (the tt is narrower in the middle), while ES rises with tail weight. ES sees the tail; VaR at moderate levels does not.

14.13.5Estimating ES on the Nifty#

Three estimators, in increasing order of structure:

  1. Historical. Sort the nn losses and average the worst ⌈n(1−α)⌉\lceil n(1-\alpha)\rceil. No model, but at 97.5% a 500-day window gives 13 tail observations, and the estimate cannot exceed the worst loss in the window.
  2. Parametric Student-tt. Fit (μ,s,ν)(\mu, s, \nu) by maximum likelihood and apply (14.12). Uses every observation to estimate the tail shape. Wrong if the tail is not tt-like.
  3. Filtered (conditional). Fit a GARCH model with tt innovations (M13 · 13.4), standardise the residuals, and apply 1 or 2 to the residuals scaled by tomorrow's forecast volatility. This is the right estimator for a daily risk number, because most of the variation in tail risk is variation in volatility (M02 · 2.7).

Worked example 14.13.2Nifty 50, computed

Daily log returns of the Nifty 50 index from Yahoo Finance (^NSEI), 18 Sep 2007 to 4 Nov 2026, n=4,693n = 4{,}693; sample standard deviation 1.292%. Losses are negative log returns.

Estimator 97.5% ES (daily)
Historical, full sample 3.99% (block-bootstrap standard error 0.40%; 95% interval 3.30%–4.82%)
Student-tt MLE (ν^=2.86\hat\nu = 2.86, s^=0.765%\hat s = 0.765\%) 3.99%
Normal with the sample mean and sd 2.98%
Historical, last 500 days (13 tail observations; sd 0.837%) 2.17%

The full-sample historical 97.5% VaR is 2.53% and the 99% VaR 3.62%. The fitted tt matches the historical ES, while the normal understates it by a quarter. The bootstrap interval is wide: even with 19 years of data the tail mean is known only to about ±20%. The last 500 days give a much smaller number because volatility was lower; the unconditional number and the conditional one answer different questions, and a risk limit should be set on the conditional one and stress-tested with the unconditional one. The estimated ν^<4\hat\nu < 4 says the fourth moment is infinite under the fitted model, consistent with the Hill estimates of M02 · 2.6. Script: block bootstrap with 20-day blocks, 2,000 resamples, seed 7.

Practitioner notes

  • ES is harder to backtest than VaR. VaR is checked by counting exceedances. ES is not elicitable: there is no scoring function whose expected value is minimised by the true ES (Gneiting 2011), so you cannot rank ES forecasts by an average score as in M13 · 13.7. It is jointly elicitable with VaR (Fissler and Ziegel 2016), and Acerbi and Székely (2014) give practical tests. For a personal book, compare the average realised loss on VaR-exceedance days with the forecast ES; with 13 exceedances a year expect the comparison to be noisy.
  • Sizing on ES. If you size so that one-day 97.5% ES is at most a fraction kk of equity, a heavy-tailed book automatically gets less capital than a normal-looking one with the same volatility. That is the behaviour 14.8 wants from a portfolio-level stress limit.
  • ES is still a number, not a scenario. It averages over the tail of a distribution estimated from the past. March 2020 and March 2026 were outside or at the edge of most estimated distributions on the day before. The next two sections add explicit scenarios.

Create a free account

Reading is open to everyone. An account keeps your progress, answers, notes and code drafts, and gives you the study plan, the journals and the simulator. Running code needs an account approved for it.