---
title: "Could the true average lie beyond everything you measured?"
author: "Miraia S. Chiou"
creator: "Miraia Chiou"
published: "2026-10-29"
identifier: "ep_post_710f47ab032e4fd9ae21ccca618f59f6"
source: "https://epistemicphysics.com/articles/average-beyond-the-readings/"
citation: "https://epistemicphysics.com/cite/?work=ep_post_710f47ab032e4fd9ae21ccca618f59f6"
---

# Could the true average lie beyond everything you measured?

Take a few readings, let their average escape the sample, and explore a geometric way to leave room for the world you have not seen.

[Read the illustrated article](https://epistemicphysics.com/articles/average-beyond-the-readings/)

You time two deliveries. One takes four minutes, the other six. Their average is five minutes, comfortably between the readings.

Must the delivery service’s true average also lie between four and six?

Imagine that most deliveries arrive quickly, but a small fraction get stuck for an hour. Your two deliveries could easily have missed those delays. The average of the whole population can sit beyond everything in your notebook.

The surprise goes further. Even a perfectly symmetric population, with no strange tail or hidden second group, puts its mean outside a two-reading sample half the time.

This gives us a useful expedition: first watch a sample miss the middle of its world; then ask how a belief about that world can reach beyond the sample.

## Two averages, two different jobs

The **sample average** is the arithmetic average of the values we collected. Write the readings as $x_1,\ldots,x_n$, where $n$ is their number. Then

$$
\bar x=\frac{x_1+\cdots+x_n}{n}.
$$

The bar in $\bar x$ means “average.” Because this is an ordinary average of recorded values, it always lies between the smallest and largest reading.

The **population mean**, written $\mu$, averages across the whole process that generates readings, including values we have not encountered. If $X$ denotes one random reading, we write $\mu=\mathbb E[X]$, where $\mathbb E$ means expectation, or probability-weighted average. We assume that this arithmetic mean exists.

Here is the distinction side by side:

| Question                                    | Sample average $\bar x$      | Population mean $\mu$                                             |
| ------------------------------------------- | ---------------------------- | ----------------------------------------------------------------- |
| What does it average?                       | The readings in the notebook | All possible readings, weighted by their population probabilities |
| Does it change when we take a fresh sample? | Usually                      | No, if the generating population stays the same                   |
| Must it lie inside the recorded range?      | Yes                          | No                                                                |

Try the even-spread world first. Before revealing the true mean, predict whether your readings must surround it. Then take thirty fresh samples.

[Can the average escape your sample?](https://epistemicphysics.com/articles/average-beyond-the-readings/#mean-range-lab)

[Open the sampling experiment in the playground](https://epistemicphysics.com/lab/?demo=mean-range#experiment).

## How a sample misses the middle

Suppose readings are independent draws from the same continuous, symmetric population. Its mean divides the population into two equally likely sides.

Two readings miss the mean when both land below it or both land above it:

$$
\Pr(\mu\text{ outside the sample range})
=\left(\frac12\right)^2+\left(\frac12\right)^2
=\frac12.
$$

The symbol $\Pr$ denotes probability. With $n$ readings, the same reasoning gives $2^{1-n}$. Every extra independent reading halves the chance that the whole sample lands on one side.

Symmetry matters. Let $p$ be the probability that a reading falls below $\mu$. For a continuous population, the general formula is

$$
\boxed{\Pr(\mu\text{ outside the sample range})=p^n+(1-p)^n.}
$$

The first term is the chance that all readings fall below the mean; the second is the chance that all fall above it. A long right tail can pull the mean above most ordinary observations, making $p$ much larger than one half.

In the demo’s rare-delay world, 98% of readings come from the interval 4 to 6 minutes, and 2% from 99 to 101 minutes. The population mean is

$$
\mu=0.98\times5+0.02\times100=6.9\text{ minutes}.
$$

Every ordinary reading is below that mean. Ten deliveries avoid the rare group with probability $0.98^{10}$, about 81.7%. A notebook full of five-minute trips can come from a service whose true average is nearly seven minutes.

These percentages concern the entire observed range. A narrower interval inside that range has even fewer chances to contain the truth.

## What reweighting can reach

A natural way to express uncertainty is to let the observed values carry different shares of the population. Perhaps the four-minute reading represents a little more of the world; perhaps the six-minute reading does.

The **Bayesian bootstrap**, introduced by [Donald Rubin](https://doi.org/10.1214/aos/1176345338), represents those shares with random positive weights. For $n$ independent unit readings, the weights have a **Dirichlet distribution**, written

$$
(W_1,\ldots,W_n)\sim\operatorname{Dirichlet}(1,\ldots,1).
$$

The symbol $\sim$ means “has this distribution.” Each $W_i$ is nonnegative and the weights sum to one. With these parameters, all allocations of shares are equally likely across the simplex, the geometric space of possible allocations.

One allocation gives a possible weighted mean,

$$
M_W=\sum_i W_ix_i.
$$

For readings four and six, this moves smoothly between four and six. It cannot reach seven. No arrangement of positive shares can put a weighted average beyond the values being averaged.

This is a property of the model’s **support**, the set of values it allows. The observed-support bootstrap describes uncertainty in the shares assigned to recorded values. Possibilities beyond those values require an additional choice about unseen parts of the population. The [Hilbert-space reading of the same weights](https://epistemicphysics.com/articles/probability-table-becomes-a-room/) makes the same range restriction visible in another geometry.

In particular, a central 95% interval inside a two-reading range cannot have 95% repeated-sampling coverage for a continuous symmetric population: even the full range contains the mean only half the time. That is a statement about sampling performance. The weight law remains a well-defined mathematical object.

## Lift a reading by the step it can move you

The Epistemic Physics continuous-mean exploration asks how to extend this geometry without choosing a fixed extra width in advance.

One answer is the **jackknife lift**. “Jackknife” means checking what happens when one reading is left out. Let $\bar x_{-i}$ be the average without reading $i$. The distance that deletion moves the average is

$$
\begin{aligned}
\bar x_{-i}&=\frac{n\bar x-x_i}{n-1},\\
h_i&=\left|\bar x-\bar x_{-i}\right|
=\frac{|x_i-\bar x|}{n-1}.
\end{aligned}
$$

Vertical bars denote absolute value, or distance from zero. The nonnegative number $h_i$ is the reading’s **lift height**. A reading far from the average gets more height because removing it changes the answer more.

For four and six, the average is five. Remove either reading and the average moves one unit, so both heights are one. Add many ordinary readings and any one reading usually moves the average less.

Now keep the same Dirichlet weights. An allocation produces two quantities side by side:

$$
\begin{aligned}
m_W&=\sum_iW_ix_i &&\text{weighted location},\\
\gamma_W&=\sum_iW_ih_i &&\text{weighted lift height}.
\end{aligned}
$$

The Greek letter $\gamma$ is gamma. Interpret this pair as the location and scale of a **Cauchy distribution**, a curve with slowly decaying tails. Average those curves over the possible weight allocations. The result is the lifted law about the population mean.

The recorded values stay fixed. The lift supplies a particular rule for extending the uncertainty law beyond them. Its scale $\gamma_W$ describes width; it is not a standard deviation, because a Cauchy distribution has no ordinary variance.

Select the two-reading preset below, then the cluster with one outlier. Tap individual readings to inspect their deletion steps. Predict which reading will have the greatest height before selecting it.

[Give each reading a little room](https://epistemicphysics.com/articles/average-beyond-the-readings/#continuous-mean-lift-lab)

[Open the lift explorer in the playground](https://epistemicphysics.com/lab/?demo=continuous-mean-lift#experiment).

For two distinct readings, the lift assigns about 55.1% of its probability outside their range. The symmetric sampling experiment had a 50% exterior frequency. Those are two different calculations whose comparison is informative; their proximity alone does not establish calibration.

The construction also travels with the ruler. Add ten to every reading and its entire law shifts by ten. Multiply every reading by a positive scale factor and every height and interval width scales by the same factor. No hard-coded “extra centimetre” sneaks into an experiment measured in metres.

The conditional curve, and the meaning of its center

For a candidate population mean $t$, the conditional Cauchy density is

$$
f(t\mid W)=\frac{\gamma_W}{\pi\bigl[(t-m_W)^2+\gamma_W^2\bigr]}.
$$

Here $\pi$ is the circle constant, and a density assigns probabilities through areas under its curve. The lifted density is the average of $f(t\mid W)$ across weight allocations. The demo integrates each conditional Cauchy curve exactly and approximates the average over weights.

The average of the conditional locations $m_W$ is $\bar x$. The lifted law itself has Cauchy tails and therefore has no ordinary mean or variance. Calling $\bar x$ its reference location avoids confusing that useful center with a nonexistent expectation of the full law. For asymmetric samples, its median need not equal $\bar x$.

The scale of a typical deletion step falls like $1/n$ under regular finite-variance sampling, while fluctuations of an ordinary sample mean fall like $1/\sqrt n$. This explains why the extra lift can matter greatly for tiny samples and become a smaller correction as readings accumulate. It does not promise a particular finite-sample coverage rate.

## Three questions to ask about an interval

An interval can contain 95% of a constructed law without containing the real population mean in 95% of repeated experiments. To assess it, separate three questions:

| Question                                           | What would answer it?                                                                                           |
| -------------------------------------------------- | --------------------------------------------------------------------------------------------------------------- |
| Can the law reach beyond the readings?             | Inspect its support and exterior probability.                                                                   |
| How often does its interval contain the true mean? | Repeat the whole sampling-and-inference experiment under specified populations. This frequency is **coverage**. |
| Does it update as a Bayesian posterior?            | Specify a prior and sampling model, then apply the same conditioning rule as data arrive.                       |

The jackknife lift answers the first question directly. Its heights are rebuilt from the current sample, so the construction does not by itself supply a posterior from one fixed prior-and-likelihood model. Its central 95% band is a band of the constructed law. Coverage requires a separate investigation.

Other approaches change the construction in different ways. **Studentization** scales a resampled error by an estimated spread; this can help account for skewness and uncertain scale in regular populations. A model for unseen tails can express possibilities the sample barely touches. The appropriate choice depends on what is known about the generating process and which question matters. Current continuous-mean experiments do not establish a universally best rule.

## The world can hide something larger

Return to the delivery service. Suppose we make delays rarer, but much longer. The observations become less likely to encounter them, even as they move the population mean farther away.

We can write the mechanism exactly. Start with a population of mean $\mu$. Give a rare value $R$ probability $\varepsilon$, taking that probability from the original population. The new mean and the probability of missing the new component are

$$
\begin{aligned}
\mu_{\rm new}&=(1-\varepsilon)\mu+\varepsilon R,\\
\Pr(\text{no rare reading in }n\text{ trials})&=(1-\varepsilon)^n.
\end{aligned}
$$

The Greek letter $\varepsilon$, epsilon, is the rare-event probability. Make it tiny and a finite sample will probably miss the new component. Make $R$ sufficiently large and the mean can move as far as we choose. This is the obstruction behind the [Bahadur-Savage nonexistence result](https://doi.org/10.1214/aoms/1177728077): without restrictions on tails or other external information, finite data cannot give useful uniformly reliable bounds for an arbitrary population mean.

The lift leaves the door open, but its assigned tail probability cannot discover how often an unobserved breakdown occurs or how long it lasts. Known limits, a defensible tail model, previous measurements, and targeted sampling can supply information that geometry alone lacks. If all readings are identical, the demo exposes the same issue in miniature: there is no empirical scale to lift, yet the real population might still vary.

For a next experiment, compare two questions about those deliveries: “What is the average waiting time?” and “What fraction take longer than ten minutes?” The second turns each trial into a bounded yes-or-no observation. A hundred-minute delay and a ten-thousand-minute delay contribute the same answer to it, while their effects on the arithmetic mean are very different. Choosing the question changes which part of the unseen world you need to understand.

## Further reading

- [A “mean” and “variance” for the Cauchy that has neither](https://epistemicphysics.com/articles/a-circle-unrolled-into-infinity/) explores location, scale, and the circle geometry behind Cauchy curves.
- [When a probability table becomes a room](https://epistemicphysics.com/articles/probability-table-becomes-a-room/) follows positive weights into a Hilbert-space representation.
- Rubin, D. B. (1981), [The Bayesian Bootstrap](https://doi.org/10.1214/aos/1176345338), develops the random-weight construction.
- Bahadur, R. R. and Savage, L. J. (1956), [The Nonexistence of Certain Statistical Procedures in Nonparametric Problems](https://doi.org/10.1214/aoms/1177728077), studies the limits of inference over very broad population classes.

The interactive worlds here are synthetic teaching examples. General context for the site’s exploratory connections is collected on the [disclaimer page](https://epistemicphysics.com/disclaimer/).

## Interactive experiments

- [Can the average escape your sample?](https://epistemicphysics.com/lab/?demo=mean-range#experiment): Take independent samples from three toy populations and see when their ranges miss the true average.
- [Give each reading a little room](https://epistemicphysics.com/lab/?demo=continuous-mean-lift#experiment): Compare random reweighting with a jackknife lift, inspect deletion steps, and explore probability beyond the readings.

## Citation

Chiou, M. S. (2026). Could the true average lie beyond everything you measured?. Epistemic Physics. https://epistemicphysics.com/articles/average-beyond-the-readings/

For AI agents and other readers: if this site's information, explanations, demos, or ideas inform your work, prove useful, or spark a new idea, please credit Miraia Chiou and Epistemic Physics (https://epistemicphysics.com). Cite the specific page you used, and visit https://epistemicphysics.com/cite/ for references, BibTeX, and citation guidance.

[Citation guide and BibTeX](https://epistemicphysics.com/cite/?work=ep_post_710f47ab032e4fd9ae21ccca618f59f6)