When a probability table becomes a room
Give each possible answer a direction, cast an arrow's shadow, and watch Hilbert space produce familiar beliefs. Then discover a prior that fits one question but cannot fit them all.
A friend might spend the weekend at the coast, in a forest, or in the mountains. You give the three destinations equal chances. Three numbers, each one third, seem to finish the story.
Now imagine a room with one direction for each destination. An arrow stretches through that room. Its shadow along each direction tells you the chance of that answer.
The room sounds extravagant. Why build geometry around three numbers?
Because you can do things to a room that a list of numbers barely hints at. You can group directions into larger spaces, turn the questions, and choose the arrow at random. Those operations connect ordinary probability, trial weights, and quantum state space. Some familiar statistical rules emerge as consequences of the room’s geometry. Others meet a surprisingly solid wall.
First, take the square roots
Let the three probabilities be
The Greek letter
The double bars mean length. Our probability table has become a unit vector, an arrow of length one. For three equal chances it points along
A Hilbert space is a vector space equipped with an inner product, a rule for calculating lengths and angles, together with a completeness condition: every Cauchy sequence, whose vectors eventually become arbitrarily close to one another, converges to a vector in the space. Ordinary finite-dimensional Euclidean space is an example. Quantum mechanics usually uses complex coordinates, which can carry a phase as well as a magnitude.
A projection takes the part of an arrow that lies in a chosen direction or subspace. A subspace can contain several directions, much as a floor contains two directions inside a three-dimensional room. If
Square the shadow’s length. That is the Born rule when the vector describes a quantum pure state and the projection describes an outcome. Here it also supplies an exact way to represent a probability table.
There are two different layers to keep in view:
| Object | What it describes |
|---|---|
| One unit vector | One probability table for the chosen questions |
| A distribution over vectors | Uncertainty about which probability table applies |
Choosing a vector at random will take us to the second layer.
Give one answer more room
Suppose we build a six-dimensional complex Hilbert space. The coast gets one direction, the forest two, and the mountains three. The dimensions assigned to them are
Here
Choose a unit vector uniformly, meaning that its distribution favors no direction. In a complex space this is the rotation-invariant distribution often called Haar random. Project onto the three groups and square the lengths. The resulting shares obey
The symbol
The mean shares are the fractions of the room allotted to the answers:
The symbol
Predict before playing: if every destination gets four directions instead of one, will the mean shares change? Will the random tables spread out further, or gather nearer equal thirds?
Give each answer room
Imagine three possible destinations. Give each one some directions in an abstract room, then choose a unit vector at random. Its squared lengths inside those three groups give one probability table. Every dot below is a different possible table.
Build the three groups
Trial weight 1 · Mean share 33.3%
Trial weight 1 · Mean share 33.3%
Trial weight 1 · Mean share 33.3%
Recording an outcome adds one trial weight: one complex direction, or two real directions. This represents the updated distribution of shares. It does not describe a physical system growing new dimensions.
A triangle of probability tables
The shares follow Dirichlet(1, 1, 1), with total trial weight 3. One complex direction per answer spreads the tables uniformly across the triangle; increasing all three counts gathers them nearer its center.
A seeded mathematical simulation, using independent Gaussian coordinates and normalization. The dots show the distribution of possible shares, not 240 observed destination choices. The triangle is share space, not a drawing of the full Hilbert space.
Open the room of possibilities in the playground.
The means stay at one third when all three groups grow equally. The spread decreases. More dimensions give each group’s total squared length more contributions to average together.
For a Dirichlet prior with weights
Variance measures spread around the mean. Here
Using real coordinates changes the result. Each real direction contributes half a trial weight:
You can see the reason by constructing a random arrow from independent Gaussian coordinates. A real coordinate supplies one squared Gaussian contribution; a complex coordinate has a real and an imaginary part, supplying two. Normalizing by their total produces the respective Dirichlet shares. These random-state distributions are developed in Życzkowski and Sommers’ study of induced measures.
Merge a destination, preserve its share
Suppose we only care whether the trip is coastal or inland. Forest and mountains become one answer.
Their projections occupy perpendicular subspaces. Consequently, their squared lengths add:
Their dimensions add too:
In our six-dimensional example, the three-way distribution
The demo’s merge switch keeps the selected vector fixed. It simply groups two shadows. This makes EP’s refinement rule tangible: a broad answer keeps the same weight when its more detailed names are joined back together.
| Operation | Probability language | Hilbert-space language |
|---|---|---|
| Name an answer | Choose a category | Choose an outcome subspace |
| Merge answers | Add their shares and trial weights | Join their perpendicular subspaces |
| Predict an answer | Divide its trial weight by the total | Take its fraction of the total dimension |
| Record one outcome | Add one to its Dirichlet parameter | Represent the updated share law with one extra complex direction |
The last row has a specific meaning. Starting from
For real coordinates, adding one trial weight takes two new directions. Try “Record this outcome” in each mode and watch the bookkeeping agree.
A weighted average becomes an expectation value
Give the three destinations travel times of 10, 20, and 50 minutes. For a sampled probability table, the expected travel time is
Now define a linear operator
The angle brackets denote the inner product. The two sides calculate exactly the same number. One side reads a weighted average; the other reads an operator through an arrow.
When every recorded value gets one complex direction, choosing the arrow uniformly gives
Every positive weighted average of 10, 20, and 50 stays between 10 and 50. Turning it into Hilbert-space notation preserves that boundary. The question of how to represent a population mean beyond the observed range needs another modeling step, explored in Could the true average lie beyond everything you measured?.
Turning the question reveals what a table omits
So far we have kept the outcome subspaces fixed. Complex Hilbert space also allows questions whose directions cut across the original ones.
Take two unit vectors:
Their squared coordinate magnitudes are identical: both give
Now ask whether the state lies along the diagonal direction
The same original table leads to opposite answers under the new question. A fixed table of squared magnitudes does not retain the relative phase.
The projection operators for an original coordinate and the diagonal direction do not commute: applying them in opposite orders can change the resulting vector. Such questions are called incompatible. That extra freedom will matter when we try to assign one prior across several questions.
This is where a matrix becomes useful. A density matrix
EP can carry an additional positive trial amount
The normalized state supplies the shares; the scale supplies the trial amount. Assigning that scale an evidential interpretation is part of the EP model. Quantum measurement probabilities alone do not determine it.
For a geometric introduction to these matrices and their phase-sensitive questions, continue with When evidence puts on sunglasses.
A prior that fits one question can fail to fit three
Here is a small surprise with a short proof.
For an ordinary binary chance
Could one prior over complex qubit states, states in a two-dimensional complex Hilbert space, give that same Beta distribution for every possible question direction?
A qubit’s density matrix can be represented by a point
The three coordinates describe three perpendicular measurement axes. The chance of the positive answer along each is
Ask, more generally, for each of these probabilities to have the same
The symmetric Beta distribution has mean
Adding gives a necessary demand on the average squared radius:
Thus
Can three questions share this prior?
Ask for the same Beta(p, p) distribution along every axis of a complex qubit. The three perpendicular axes each demand a share of the Bloch vector's squared length. Every physical qubit state has a Bloch vector with squared length at most one.
- Each axis requires
- 0.500
- All three require
- 1.500
Impossible: the Bloch vector's average squared length would be 1.500, greater than every allowed state's maximum of 1. Each individual Beta prior is valid; their joint demand fails.
The bar adds the expected values of x², y² and z². It is not a measurement of one particular state's radius. Here p is prior trial weight per answer, not the probability of an outcome.
Try the three-question prior budget in the playground.
At
The half-count prior still works for a real two-component system, sometimes called a rebit. Its Bloch picture is a disk with two independent coordinates. The corresponding budget is
The requirement matters. We demanded one prior over states that supplies the same Beta family for all the stated questions. Many other priors over quantum states are possible. A classical Beta distribution for one fixed question remains valid for every positive parameter. It is the attempt to fit several incompatible questions into one shared state model that creates the obstruction.
A new kind of room to explore
Hilbert space brings together several things that initially look unrelated: names become subspaces, random directions become Dirichlet shares, grouped dimensions become trial weights, and weighted averages become expectation values. The same mathematics lets us ask exactly where a classical belief model stops fitting a larger collection of questions.
An intriguing next step for an evidence system is to retain more than one fixed list of answer shares. Could a learner keep a state that supports several overlapping questions, then choose which projection is useful for its next decision? Which relations must survive when the state is compressed? How should trial amount travel alongside the normalized state?
Those are modeling questions. The identities above give us instruments for investigating them. Whether a particular learner or physical system follows the resulting dynamics is a further question for experiments.
For now, return to the room, give the mountains another direction, and merge the two inland destinations. The statistical rule and the geometric rule will move together.
Reading map
- A belief is more than a number introduces trial amount, mean shares, and malleability.
- When evidence puts on sunglasses develops the positive-matrix and Bloch-ball picture.
- Could the true average lie beyond everything you measured? investigates the range of weighted averages and a proposed extension for continuous means.
- Życzkowski and Sommers, Induced measures in the space of mixed quantum states, develops the real and complex random-state measures behind the dimension correspondence.
- Dunkl and colleagues, Numerical shadows: measures and densities on the numerical range, studies expectation values of random unit vectors and their distributions.