When evidence takes different roads
Reconstruct beliefs from report fragments, hidden causes, active questions, and complex joint tables.
Four headlines announce the same discovery. You feel increasingly sure it happened. Then someone opens the footnotes: every headline copied the same press release.
Now try a different experiment. Ask someone about their happiest memory, then ask whether the world feels welcoming. Reverse those questions tomorrow. The first question might change what the second encounters.
Evidence has routes. It can be copied, hidden behind a common cause, or collected through an interaction that changes the scene. Following those routes leads us from ordinary Bayesian inference into split-complex algebra, positive matrices, and joint tables whose entries point in imaginary directions.
Epistemic Physics gives us a lively question to carry along: what must a belief remember about how its tracelets arrived?
One source can wear four name tags
Let
The symbol
Odds express a probability
Suppose four headlines copy that answer perfectly. Conditional on the original answer, their wording supplies no further information about
Four independently generated yes answers give a different calculation. Here independence means that, once
That is approximately
Four headlines. How many sources?
Every headline says “yes.” Each original source is 80% accurate in either direction, and the claim starts at 50%. In this model, separate sources are independent once the claim's truth is fixed. Tap a headline to cycle its source, or choose its source below.
- Original source factors
- 1
- Posterior using the source graph
- 80.00%
- If every headline were independent
- 99.61%
Here m is the number of independent original source answers. Copying an answer leaves m unchanged.
A hidden source can also connect two measurements
Let h be a common signal. Each reading adds its own independent noise: x = h + εₓ and y = h + εᵧ. All three input variables have variance one.
Independent conditional on a known h
Integrating out h averages over its unknown value. Both readings inherit its variation, which becomes a visible connection between them.
Open the source experiment in the playground.
A source ID answers “which original event was this?” A dependence model answers “how were these different events related?” Separate reporters may share a witness, an instrument, or a training dataset. Distinct names alone establish no independence. The demo explicitly supplies independent source errors; changing that assumption calls for a richer graph.
A factor graph represents a joint model as small pieces called factors. Each factor connects the variables appearing in one local relationship. Summing over hidden variables and multiplying the appropriate factors produces the desired probabilities. This makes source relationships part of the calculation. Kschischang, Frey, and Loeliger, Factor graphs and the sum-product algorithm.
Bayes has a two-channel algebra
Picture two tracks carrying unnormalized weights
We can package those tracks into a split-complex number. Introduce a unit
Multiplication reveals a delightful arrangement:
The two channels reproduce themselves and never cross. Encode the belief weights and a likelihood message as
Here
Each message scales its own track. Define rapidity, half the logarithm of the odds, by
Multiplication now becomes translation:
A prior probability of
Three ways to combine things
How does this multiplication fit with adding fresh trials in a Beta belief? The objects being combined tell us which operation to use.
| What arrives? | What we keep | How it combines |
|---|---|---|
| Fresh support and opposition | Raw trial amounts | Add their amounts |
| A likelihood message | A function of the unknown state | Multiply the likelihood factors |
| Two analyses of independent datasets | Posterior densities with a common prior | Multiply, then divide out one shared prior |
For a success probability
Likelihood multiplication adds exponents. That is why fresh trials add to the Beta shapes.
Let
The symbol
Here is an unexpectedly sharp example. Give both analyses the prior
whose integral diverges near
If the datasets also overlap, each common likelihood factor must occur once. A lineage record gives this algebra somewhere concrete to attach: original events create factors; repeated appearances point back to them.
Reconstruct a law from scattered fragments
FLogic’s tally idea takes us further: join report fragments by lineage, keep the likelihood factors they imply, and reconstruct a distribution from those factors.
Imagine surveying unfamiliar creatures. Let
Choose a joint model with four possible answer combinations, called worlds:
A Dirichlet distribution places a probability distribution over that four-entry vector. Choose
Each world receives a quarter of the prior amount, keeping the total at one. Our question is the unknown frequency
If the fragments describe one event, they join into a complete
If they describe different events, each observation leaves one answer missing. The likelihood becomes
Each term describes a compatible completion of the missing answers. Multiplication by the prior adds that term’s exponents to the four Dirichlet shapes. Projecting onto
The weights specify how much each component contributes to the resulting distribution. They include Dirichlet integrals, the prior averages of the likelihood terms. The squared term averages to
This mixture has mean
Two fragments, one reconstructed belief
Two fragments say A = 1 and B = 1. Should the archive join them into one event, or retain two? Inspect their event stamps, then choose. Matching answers alone cannot identify their lineage.
Read the stamps before deciding. The answer fields alone leave the event identity unresolved.
A = 1
B = ?
A = ?
B = 1
Open the archive workbench and posterior
No extra report copies. A question mark means the answer was not recorded.
Join the fragments, then multiply the event factors
Exact mixture for q = θ₁₁
q is the chance that A and B are both one. Each row contributes a Beta distribution with the displayed weight and shapes α, β.
- Report appearances
- 2
- Unique observed events
- 1
- Posterior mean of q
- 5/8 = 62.50%
- Variance of q
- 0.0781
The two fragments complete one A = 1, B = 1 observation. Their shared event contributes one complete factor. Copies and arrival order leave this law unchanged.
Compare the entire distributions
A cumulative distribution gives the probability that q is at most a threshold t. Drag the gold marker along the horizontal axis, use its arrow keys, or choose the buttons below.
At t = 0.50, the selected posterior places 33.04% of its probability at q ≤ t.
Open the likelihood expansion
Each monomial adds its exponents to the four Dirichlet shapes. Its mixture weight includes the monomial's coefficient and its integral under the prior. Equal polynomial coefficients need not give equal posterior weights.
Term 1: coefficient 1; prior integral 1/4; normalized weight 1.
Model: independent event draws conditional on four unknown joint frequencies, direct answers, and ignored missing fields. Each category starts with prior weight 1/4. Matching event identity allows joining; it alone does not establish independence between distinct events.
Open the reconstruction experiment in the playground.
Copy a report and the reconstructed law stays fixed. Shuffle the reports and it stays fixed again: these likelihood factors commute. Changing which fragments refer to the same event can change the law, because it changes the factors themselves. Revealing a missing field supplies another way to refine a factor.
After joining the fragments, a tally of distinct compatible-world factors preserves the likelihood for this chosen joint model. The current calculation can use those counts; retained lineage can still support later joins and duplicate checks. This offers a compact architecture for a belief engine that carries a whole distribution forward through a changing network of reports.
Hide a cause, and a connection appears
Imagine two sensors measuring the same fluctuating room temperature. Write
where
If we know
Covariance measures their shared fluctuation. Correlation divides covariance by the two standard deviations, producing a dimensionless quantity.
The full Gaussian density has exponent
Complete the square in
Integrating the first term’s Gaussian leaves a constant. The remaining expression couples
This is an example of a Schur complement. A Gaussian’s precision matrix is the inverse of its covariance matrix. Partition a precision matrix into retained variables, hidden variables, and their connections:
The superscript
For our sensors,
Notice another familiar shape. For any real positive two-by-two precision matrix
An ordinary Gaussian source graph contains the same cone identity we encounter in matrix evidence geometry. Here the coordinates have precision units; raw trial amounts retain their own units.
This suggests a useful kind of memory compression. A detailed graph can retain who measured what, while a compact graph retains the dependence created when hidden causes are averaged away. The two descriptions can agree exactly for the chosen Gaussian model. Zooming out changes which connections are explicit.
A question can move the thing it measures
Now imagine an interview, a learning session, or a sequence of selective filters. Let us model each successful interaction as actively changing a positive matrix
The dagger means conjugate transpose. Normalize by the trace, the sum of diagonal entries, to obtain the state
A two-by-two state can be written
where
Choose two filters:
The rapidities
Start from
The final horizontal yes probabilities are
Build a route through two questions
Choose which filter acts first, then apply them one at a time. Each successful filter moves the state. Before comparing routes, predict which order leaves the stronger horizontal “yes.”
Balanced start. Choose a route and apply its first filter.
Change filter strengths and inspect the mathematics
Compare passive Bayes messages
A second control: observe an unchanged hypothesis
Ordinary fixed likelihood messages multiply in either order. Starting from equal odds, factors 4 and 9 both give posterior probability 36/37. The active filters above change the state between questions.
Open the question-order experiment in the playground.
A prediction about gentle interactions
For arbitrary perpendicular strengths, direct calculation gives
Here
When both strengths are small,
We also have two controls. Filters aligned with the same axis commute, meaning their order leaves the endpoint unchanged. Fixed classical likelihood factors about an unchanged hypothesis commute as well:
For a physical success/failure experiment at the chosen strength, use
A table can remember an imaginary direction
The previous experiment changed the state actively. We can also build a joint representation that compares two questions against the same initial state.
A projector
The Kirkwood-Dirac quasiprobability is
It is a probability-like representation whose entries may be complex or negative. Summing a row or column gives an ordinary probability for the corresponding question asked on its own. This representation has applications ranging from quantum measurement to thermodynamics. Arvidsson-Shukur and coauthors, Properties and applications of the Kirkwood-Dirac distribution.
Multiply our little matrices:
Every imaginary part cancels in each marginal:
For
Reverse the operator order. Each entry becomes its complex conjugate, meaning the imaginary part changes sign:
The connection to order is exact. Define the commutator by
The imaginary component records the expectation of this operator-order difference in the chosen state. At the balanced center, the same noncommuting question operators produce a real, positive table. The state matters too.
A joint table with turning arrows
A complex number has a horizontal real part and a vertical imaginary part. Each arrow below represents one entry of the Kirkwood-Dirac table for z and x questions. Reverse the question order, then compare the table with frequencies from actual successive sharp measurements.
Choose the state
The three coordinates obey vₓ² + vᵧ² + v_z² ≤ 1. At vᵧ = ±1 the allowed disk shrinks to a point; move vᵧ inward to open it.
Kirkwood-Dirac entries
Rows fix the z answer; columns fix the x answer. Horizontal arrow components give real parts; upward components give positive imaginary parts. Row and column sums cancel the imaginary parts.
- z yes, asked on its own
- 50.0%
- x yes, asked on its own
- 50.0%
- Smallest state eigenvalue
- 0.000
- Negative real weight in the KD table
- 0.000
The state matrix remains positive throughout this experiment. Reversing the operator order keeps every real part and flips every imaginary part. The ordinary single-question probabilities stay the same.
Open the complex-table experiment in the playground.
A positive state with a negative corner
Turn the state toward the diagonal:
Its state eigenvalues are one and zero, both nonnegative. Yet
The two separate yes probabilities are each
What would an actual sequence of sharp measurements record? It includes the state change caused by the first question:
These are ordinary positive frequencies. After a sharp vertical answer, the horizontal answer is fair for our perpendicular axes. Reversing the experiment instead gives
The imaginary coordinate
Build a belief that remembers its journey
Let us imagine a research assistant whose internal evidence lives in a graph. A paper, instrument reading, or interview creates an original source event. Reports and summaries carry tracelets pointing back to that event. Likelihood messages propagate through the graph, with each factor represented once. Hidden causes can be integrated out when a smaller dependence model is useful.
Now give some interactions an active matrix transformation. A question can bring a memory into focus; a rehearsal can strengthen one direction; a selective observation can change what remains available. Model those operations explicitly and retain their order. A final answer is a specified readout of the resulting state.
There are several scales of ambition here. A small implementation could repair copied-source Bayesian pooling. A larger one could combine source graphs with stateful interview models. An adventurous one could learn both the latent state and the transformations produced by different questions, then choose a question for the path it opens through future states.
Such a system would have an unusual form of curiosity. It could ask whether another report adds an origin, whether a hidden cause explains an apparent connection, or whether a question will change the experiment that follows. Its memory would preserve routes through evidence as well as the answers found along them.