What the average leaves out
How much can hide behind the same mean?
Suppose two scientific committees vote on the trajectory of a spacecraft.
Committee A splits completely East versus West: half the members vote East, half vote West.
Committee B splits completely North versus South: half vote North, half vote South.
Both committees produce the exact same mean velocity: zero! Yet their internal disagreements are entirely orthogonal.
A single average point discards this crucial geometry. To recover it, we must look at higher moments.
Covariance and the second moment
In statistics, the mean is the first moment. The second moment captures how the coordinates fluctuate together around that mean.
Under a directional Dirichlet process with base distribution
The matrix
Covariance recovers the axis along which the disagreement took place.
Equal centers, different uncertainty ellipses
Consider our two committees under a uniform circle prior with unit concentration.
One East and one West observation give a horizontal covariance ellipse:
One North and one South observation give a vertical covariance ellipse:
Both states have identical total concentration (
Your turn
Rotate the two opposing observations around the circle in the lab. Watch the covariance ellipse turn in real time while the mean point and cone norm remain pinned at the center.
Same center. Different story.
Two equally weighted trials point in opposite directions. Their average is always zero. Turn the rose pair by dragging either endpoint and watch its ellipse turn. The dashed blue east-and-west pair stays visible for comparison on the same axes.
- Total concentration τE
- 3
- Mean velocity
- (0, 0)
- Cone norm mE
- 3
| Variance | East & west | Rotated 90° |
|---|---|---|
| In x | 0.2083 | 0.0417 |
| In y | 0.0417 | 0.2083 |
Where the extra shape could help
Imagine steering a spacecraft with an uncertain starting direction. A horizontal cloud of possible directions and a vertical cloud can spread into different futures, even when their mean agrees.
This suggests an experiment: propagate the full directional belief alongside its mean, then compare which description anticipates the spread of later paths. In a sensitive dynamical system, small initial differences can grow quickly. Covariance gives us a first way to retain those differences and ask whether they help prediction.
The two committees already show the exact mathematical point: matching the mean and cone norm leaves room for different shapes of disagreement.
The mean is only the first moment. Covariance and higher moments preserve the shape of disagreement, giving us more to carry into predictions about a changing system.