Skip to content
Glacius
ProbabilityConcept reference

Sample mean variability

The mean of n IID observations with finite variance v has variance v divided by n.

On this page 7 sections
  1. Overview
  2. For n IID observations with finite individual variance v, the average has variance v/n
  3. If an individual standard deviation is supplied, square it to obtain v
  4. At n=1, the variance stays v
  5. Key takeaway
  6. Sources & further reading
  7. Concept connections

01For n IID observations with finite individual variance v, the average has variance v/n#

For nn IID observations with finite individual variance vv, the average has variance v/nv/n. Here nn is a positive integer. The formula concerns variation across fresh samples.

The sum of nn independent observations has variance nvnv. Dividing that sum by nn multiplies its variance by 1/n21/n^2.

Var(Xˉ)=nvn2=vn\operatorname{Var}(\bar X)=\frac{nv}{n^2}=\frac vn

With four observations of variance 44, the sum variance is 1616. Averaging multiplies it by 1/161/16, leaving variance 11.

Four IID observations each have variance 4 and SD 2. Their sum has variance 16 and SD 4; dividing by 4 produces average variance 1 and SD 1. Spans share a distance scale and represent spread around each variable’s own mean, not distribution shapes.Four IID observations each have variance 4 and SD 2. Their sum has variance 16 and SD 4; dividing by 4 produces average variance 1 and SD 1. Spans share a distance scale and represent spread around each variable’s own mean, not distribution shapes.
Figure 1Four IID observations each have variance 4 and SD 2. Their sum has variance 16 and SD 4; dividing by 4 produces average variance 1 and SD 1. Spans share a distance scale and represent spread around each variable’s own mean, not distribution shapes.
Link to this figure ↗Download SVGDownload PNG
Check your reasoning

IID observations: n=6, finite variance of each=18. Variance of the average?

Show answer and explanation
3

18/6 = 3.

02If an individual standard deviation is supplied, square it to obtain v#

If an individual standard deviation is supplied, square it to obtain vv. For standard deviation 55 and n=5n=5, mean variance is 25/5=525/5=5. Variance uses squared measurement units.

Check your reasoning

IID readings: n=4, individual standard deviation=6. Finite variance. Variance of the average?

Show answer and explanation
9

36/4 = 9.

03At n=1, the variance stays v#

At n=1n=1, the variance stays vv. At v=0v=0, it stays zero for every positive nn. Copies of a nonconstant random variable are dependent; the IID shortcut is unjustified.

Check your reasoning

IID observations: n=4, finite variance of each=8. “Divide by n squared.” Repair mean variance.

  1. A1/2
  2. B2
  3. C8
Show answer and explanation
2

8/4 = 2.

Key takeaway

Independent variances add, then averaging scales variance by the square of 1/n. The result is v/n.

  • Compute IID sample-mean variance.

Sources & further reading

  1. [1]
    Pishro-Nik, Introduction to Probability, 8.1.1 Random SamplingPishro-Nik, Introduction to Probability · Book

Reference this concept

Link to this page, a section, or an individual figure.

Glacius. “Sample mean variability.” Math behind ML. /learn/p-sample-mean