Skip to content
Glacius
ProbabilityConcept reference

Chebyshev's inequality

Chebyshev bounds P(|X−μ|≥d) by Var(X)/d² for positive d and finite variance.

On this page 7 sections
  1. Overview
  2. Chebyshev bounds how often a variable lies at least a distance d>0 from its mean μ
  3. For a symmetric open band, measure from the center to either endpoint
  4. Chebyshev provides a ceiling on the tail probability
  5. Key takeaway
  6. Sources & further reading
  7. Concept connections

01Chebyshev bounds how often a variable lies at least a distance d>0 from its mean μ#

Chebyshev bounds how often a variable lies at least a distance d>0d>0 from its mean μ\mu. It needs finite variance, without requiring a normal distribution.

P(Xμd)Var(X)d2\begin{gathered}P(|X-\mu|\ge d)\\\le\frac{\operatorname{Var}(X)}{d^2}\end{gathered}

With mean 10 and variance 4, distance 4 gives a bound of 0.25. This includes both tails: values at most 6 or at least 14.

Mean is 10 and variance is 4, so SD is 2. Deviation at least 4 selects X≤6 or X≥14, including both boundary points. Chebyshev bounds this tail probability by .25; no distribution shape or exact tail mass is specified.Mean is 10 and variance is 4, so SD is 2. Deviation at least 4 selects X≤6 or X≥14, including both boundary points. Chebyshev bounds this tail probability by .25; no distribution shape or exact tail mass is specified.
Figure 1Mean is 10 and variance is 4, so SD is 2. Deviation at least 4 selects X≤6 or X≥14, including both boundary points. Chebyshev bounds this tail probability by .25; no distribution shape or exact tail mass is specified.
Link to this figure ↗Download SVGDownload PNG
Check your reasoning

Mean 33, variance 22. Bound P(X34)P(|X-3|\ge 4) by Chebyshev, capped at 11.

Show answer and explanation
0.125

Distance is 44; variance divided by its square is 2/16=0.1252/16=0.125. Use upper bound 0.1250.125.

02For a symmetric open band, measure from the center to either endpoint#

For a symmetric open band, measure from the center to either endpoint. The whole band width would double the distance incorrectly.

The same bound follows by applying Markov to the nonnegative squared deviation. If the ratio exceeds 1, retain the trivial bound 1.

Check your reasoning

Mean 1212, variance 44. Bound the probability outside the open band (8,16)(8,16) by Chebyshev, capped at 11.

Show answer and explanation
0.25

Distance is 44; variance divided by its square is 4/16=0.254/16=0.25. Use upper bound 0.250.25.

03Chebyshev provides a ceiling on the tail probability#

Chebyshev provides a ceiling on the tail probability. It cannot turn a mean and variance into an exact tail probability for every distribution.

The endpoints count in the deviation event because it uses d\ge d. The inside event is the open band Xμ<d|X-\mu|<d.

Check your reasoning

Mean 55, variance 99. Report: P(X56)=0.25P(|X-5|\ge 6)=0.25. Capped Chebyshev correction?

  1. AExactly 0.25
  2. BAt most 1
  3. CAt most 0.25
Show answer and explanation
At most 0.25

9/62=0.259/6^2=0.25.

Key takeaway

Divide variance by squared distance; cap at 1 and keep the upper-bound interpretation.

  • Bound a deviation probability using finite variance.

Sources & further reading

  1. [1]

Reference this concept

Link to this page, a section, or an individual figure.

Glacius. “Chebyshev's inequality.” Math behind ML. /learn/p-chebyshev