A workshop for beliefs
Springs, circuits, spacecraft, chemical buffers, and robot maps share a surprising toolkit for building systems that learn. Take Epistemic Physics into the engineering workshop.
An engineer walks into a workshop carrying a belief.
At the first bench, someone wants to know how stiff it is. At the next, someone attaches a capacitor and asks how quickly it forgets. A roboticist wants to bolt it into a map. A chemical engineer pours it into a beaker. Upstairs, the aerospace team is already asking whether it will still work when the reference frame rotates.
These are excellent questions to ask of a belief.
Epistemic Physics gives us a way to bring them into the same room. Its evidence ledger retains both the direction a belief points and the amount behind it. Its geometry connects those quantities to velocity, inertia, and rapidity. Now we can try something practical: take that geometry apart, lay its pieces on the bench, and see which engineering tools fit.
This field trip follows those ideas into mechanical, electrical, aerospace, chemical, and civil engineering, with a robot wandering between the benches.
| Workshop | The connection to explore |
|---|---|
| Mechanical | Evidence resists updates; Gaussian precision acts like spring stiffness. |
| Electrical | Fading memory follows a low-pass circuit, including a leakage path for the prior. |
| Aerospace | Navigation alternates prediction and correction while keeping track of geometry. |
| Civil | Structural stiffness and estimation precision share an assembled network matrix. |
| Chemical | Composition is a ratio; buffering depends on both balance and total amount. |
| Robotics and SLAM | Maps are networks of uncertain constraints whose observations have lineage. |
Put a belief on the workbench
Suppose a component passes
The halves are our starting prior. They leave room for both possibilities before any measurements arrive. The ledger’s total, including that prior, is
Epistemic Physics calls this epistemic time. It measures accumulated trial amount; an ordinary clock measures elapsed time. We will use
Three other quantities will accompany us:
Here
The other useful coordinate is rapidity, half the natural logarithm of the odds:
A little notebook and a huge notebook can point at the same
Mechanical engineering: a spring can take a measurement
Imagine a little carriage sliding along a rail. One spring wants it at position
The stored elastic energy is
At equilibrium, the opposing pulls balance. Differentiating with respect to the carriage position
Now give an estimation engineer two independent Gaussian measurements of that same position. A Gaussian is the familiar bell-shaped distribution. Let the measurement variances be
Multiplying their Gaussian likelihoods gives the very same quadratic expression in the negative logarithm. The combined estimate is
Precision plays the role of stiffness. Each observation brings a preferred position and a strength of pull. The algebra survives the change of workshop; the units change with it. Spring systems and their quadratic energies are developed in MIT’s treatment of spring networks.
| The same job | Spring carriage | Gaussian position estimate |
|---|---|---|
| Each contribution asks for | Its resting position | Its measured position |
| Strength of pull | Stiffness | Precision |
| Balanced answer |
For example, let one contribution ask for position
Our Beta notebook has its own response law. Let a new result be
The superscript
That already looks like an engineer’s correction rule: present estimate, plus an error signal, times a gain. Keep that equation handy. We will meet its relatives at almost every bench.
There are several kinds of resistance here. A spring’s stiffness sets its static displacement under force. A mechanical mass sets its acceleration under force. A ledger’s trial amount sets the change produced by a new trial. Giving each one its own response equation is how we turn the resemblance into something we can build with.
Electrical engineering: put the memory in a circuit
An ordinary resistor-capacitor circuit, or RC circuit, is a tiny machine for remembering the recent past. The capacitor stores charge. The resistor limits how quickly charge moves. For input voltage
The product
Our notebook with fading memory has supporting and opposing arrival rates
A dot means differentiation with respect to ordinary time. Let the total arrival rate be the constant
The memory time is
We can build that feature into the circuit too. Connect the capacitor to the input through resistance
with
The second resistor gives the prior a physical address: a leakage path toward neutral.
| The same job | Fading evidence, after the total settles | Circuit with a ground leak |
|---|---|---|
| Stored output | Centered mean | Capacitor voltage |
| Incoming signal | Trial balance | Input voltage |
| Response equation | ||
| Memory time |
After one memory time following a constant input, either output has covered about
Before touching the controls, predict what very long memory will do to an oscillating signal. Then try very short memory. How much evidence remains to compete with the prior?
How much of the past should it keep?
The environment oscillates. Old observations fade while the neutral prior stays at one. Change the memory and see how much of the signal the belief follows. A matched resistor-capacitor circuit follows the same signal, with its voltage on the same scale.
The sky dashes sit on the teal curve: the two systems have the same periodic response after their initial adjustment, with the evidence total settled. “Largest response” maximizes the output amplitude for these settings; its nearest slider value is shown. Long memory smooths the signal. Very short memory leaves the prior with a larger share.
A notebook with fading trials
Incoming balance u drives the centered mean vE.
Memory time 1.60 Gain for slow signals 0.950A capacitor with a ground leak
Input voltage Vin drives capacitor voltage V.
Memory time 1.60 Gain for slow signals 0.950A dot means change per unit time. The forgetting rate is κ = 1 / memory time, and g is the fraction of a very slowly changing input that gets through. The circuit uses matched units with capacitance C = 1, input conductance κg = 0.594, and ground conductance κ(1 − g) = 0.031. Conductance is the reciprocal of resistance; the ground path supplies the pull toward neutral.
The same equation also lives in a well-mixed thermal room, where heat capacity stores the past and thermal conductance connects the room to its surroundings. Electrical storage, thermal storage, and evidence storage invite the same questions about delay, damping, and responsiveness.
Kalman filters: let uncertainty choose the pull
A navigation system must combine two stories: where its motion model predicts it should be, and where a noisy sensor says it is.
Consider a scalar position estimate with predicted mean
The difference
This is the two-spring calculation wearing a navigation badge. The predicted estimate brings precision
Where does prediction variance come from? In the simplest random-walk model, we carry the previous mean forward and add a process variance
Process noise represents uncertainty introduced as the state evolves. Repeated measurements tighten the estimate; uncertain motion opens it up again. That competition gives a tracking system its memory. The gain adapts to the variances propagated by the model; choosing or learning
Now return to the Beta ledger. We already found
The connection goes deeper than matching the typography. If
Covariance measures how two quantities vary together. Their ratio gives exactly our gain:
We can place the quantities directly into the usual Kalman formula. Write
The binary sensor’s noise depends on
A surprise awaits in the variance. For a Beta belief, an unexpected outcome can widen the posterior. Averaging over the two possible outcomes restores the familiar contraction:
The mean correction is exact for each binary result. The variance contraction holds on average over the next result. The demo lets us watch both at once.
One reading, the same mean update.
Give both rules the same starting belief and the same binary reading. The Beta rule adds a trial; the Kalman rule combines variances. Watch them produce the same gain and move the mean to exactly the same place.
Beta belief update
- Mean before
- 95.00%
- Reading z
- 0
- Gain K
- 9.09%
- Mean after
- 86.36%
Kalman mean update
- Mean before
- 95.00%
- Reading z
- 0
- Gain K
- 9.09%
- Mean after
- 86.36%
Both rules move the mean from 95.00% to 86.36%. The shared calculation is 0.9500 + 0.0909 × (0 − 0.9500) = 0.8636.
For the Kalman column, V = 0.004318 is the starting belief variance. R = 0.043182 is the binary sensor's average noise variance. Because R = τEV, its gain V/(V + R) is exactly 1/(τE + 1).
What happens to the variance?
The Kalman variance matches the Beta variance averaged over the next result. This particular failure widens the Beta curve.
See the Beta curve before and after
Before the reading
The density diverges at p = 1. The curve is sampled only inside (0, 1).
After this reading
The mean is μ; prior-inclusive trial amount is τE = 10. The prior contributes half a trial per channel. “Expected Beta” weights a success by 95.00% and a failure by 5.00%.
Try the initial nine-success streak, then deliver one failure. The gain is only
Give the filter a working memory
The circuit at the previous bench used a fixed response rate. A discrete memory can do something similar: move a fixed fraction of the distance toward every reading. A Kalman tracker uses the same form of correction and chooses that fraction from its current variances.
| After a direct sensor reading | Fixed-gain memory | Kalman tracker |
|---|---|---|
| Mean correction | ||
| Fraction of the distance | A chosen constant | |
| During a gap in readings | Hold the previous mean | Hold the mean and add |
Suppose the sensor goes quiet while the world keeps moving. With
Keep track when the sensor goes quiet.
Follow the same moving signal with a Kalman filter and a fixed-gain memory. Scrub through the readings. During a sensor outage, watch the Kalman band widen; then see how strongly the returning measurement pulls.
Drag the gold time handle to walk forward or back through the readings.
- Predicted mean / SD
- -0.549 / 0.663
- Updated mean / SD
- -0.881 / 0.445
- This reading
- -1.153
- Kalman gain
- 0.550
The reading pulls the prediction 55.0% of the way toward it. The fixed memory always moves 20% of the distance from its own estimate to the reading.
SD means standard deviation; the shaded band is the Kalman estimate ±2 model SDs. The world takes independent steps with SD 0.15, with an added jump in the jump scenario. The sensor's SD is known to the filter; the expected motion is your model choice. The same random sequence is reused as you adjust the settings. Both filters use only readings up to the selected step.
Try setting expected motion to zero. The filter now acts as though it is estimating one fixed quantity, so repeated readings progressively reduce its gain. It also stops widening its estimate during an outage. Switch to the sudden-jump example and see the price of that assumption.
An unexpected reading changes the mean through its innovation. With
Nonlinear sensors: a tangent or a scouting party?
Real sensors enjoy bending things. A camera projects a three-dimensional scene onto a plane. A rangefinder measures a square root of squared distances. A chemical detector saturates. A robot’s turning motion mixes angles and positions.
To isolate the difficulty, imagine a hidden rapidity
The noise
An extended Kalman filter, or EKF, replaces the curved sensor by its tangent near the current estimate. The slope is
It then uses
An unscented Kalman filter, or UKF, sends a small, carefully weighted collection of representative points through the actual curve. These sigma points are a scouting party placed around the estimated state. Their transformed positions approximate the predicted reading, its variance, and its covariance with the state. Those quantities supply the correction gain. MathWorks documents both constructions and their prediction/correction steps.
The EKF asks how the sensor bends right here. The UKF samples how it behaves across the current spread. A numerical Bayesian calculation can go further and retain the whole posterior curve. Let’s give all three exactly the same problem.
Send a belief around a bend.
A sensor measures a hidden rapidity ρ. Its response can be straight or saturating, like a detector running out of range. Predict which filter will stay closest to the gold curve after one noisy reading.
What the sensor sees
What the filters believe
Drag the teal center scout along the sensor curve, or move the sky-blue reading up and down.
| Method | Predicted reading | Updated ρ mean | Updated ρ spread |
|---|---|---|---|
| ● EKF | 0.000 | 0.733 | 0.148 |
| ● UKF | 0.000 | 0.948 | 0.193 |
| ● Bayes reference | 0.000 | 1.081 | 0.408 |
The EKF follows the tangent at ρ = 0.00. The UKF sends scouts to 0.00, -1.00, 1.00. The gold curve keeps the full posterior shape.
Spread here means standard deviation. The gold curve comes from numerical integration. The prior is Gaussian in rapidity; probability is p = (1 + tanh ρ)/2. Noise is added to the analog reading, so a reading can pass ±1. This lab isolates one correction step; a tracking filter repeats prediction and correction.
How the three scouts are weighted
These are deterministic sigma points, not observed trials. Their mean weights are 0, ½, ½; covariance weights are 2, ½, ½. This is the scalar scaled unscented transform with α = 1, β = 2, κ = 0. Both approximations retain a Gaussian in rapidity.
Start with the straight-agreement example: the rose tangent lies on the sensor curve, and all three posterior answers meet. Try the broad belief and watch the teal scouts reach around the bend. Then choose the saturation example. The tangent becomes nearly flat while a reading of zero asks the belief to move toward the middle. The gold curve can become asymmetric while the two filters keep bell-shaped summaries. Which summary follows its center better depends on the setting.
This is an especially useful lesson for Epistemic Physics. Moving the mean through a curved function generally differs from moving the whole distribution and then taking its mean:
A beautiful coordinate change can simplify the dynamics while changing the shape of uncertainty. Rapidity makes multiplicative changes in odds additive. We still get to choose how much of the resulting distribution our estimator carries.
There is another connection hiding in the slope. For
The sensor learns most near balance and least near saturation. The same geometric factor appears in the evidence cone:
This suggests an engineering question with teeth: should a sensing system change its operating point to stay where new measurements can still move its estimate? Our receptor-bank experiment explores that idea by spreading sensors across different tunings.
Aerospace: the estimate needs a reference frame
A spacecraft carries more than a position estimate. It has velocity, orientation, drifting instrument biases, and measurements expressed in different frames. NASA’s GEONS navigation software, for example, uses an extended Kalman filter architecture for onboard orbit determination. NASA describes its implementation and flight applications.
Orientation introduces a wonderful geometric snag. You cannot treat every rotation like an ordinary displacement on a flat sheet. Turn a book around two different axes in opposite orders and you can end in different orientations.
Rotations form a group: they have a composition rule, an identity rotation, and inverses. Smooth groups are called Lie groups. Robotics often uses
An invariant extended Kalman filter uses the symmetry of such a state space to define and propagate its estimation error. Barrau and Bonnabel show how this can give useful stability properties for a class of systems, including mobile robotics and inertial navigation. Their paper develops the construction.
Epistemic rapidity offers a small, unusually friendly workshop for this kind of thinking. A boost by
Its composition law is simple addition. An uncertainty model can be built around errors in that coordinate, then projected back to probability when a reading is needed. In a spacecraft, the corresponding design question is which geometric error to propagate for orientation and motion.
Both invite us to design the estimator around the transformations its state actually undergoes. A coordinate system becomes part of the machinery.
Civil engineering and SLAM: let the network settle
Now roll our carriage into a larger structure. Several nodes are connected by springs. Each connection has a preferred displacement and a stiffness. The whole structure finds a compromise by balancing the forces at every free node.
A robot building a map faces much the same problem. SLAM means simultaneous localization and mapping: estimating where the robot is while also estimating the surroundings it uses to locate itself. Wheel motion supplies relative displacements. Cameras and rangefinders connect positions to landmarks. Revisiting a place adds a loop closure, a constraint linking parts of the route that were previously connected only through a long chain of uncertain motion. GTSAM’s tutorial introduces these factor graphs and mapping examples.
A factor is one contribution to the joint model, such as a measurement likelihood. In a simple one-dimensional Gaussian model, an edge from node
Here
Add all the edges, and we have both a spring network and a map estimator. Before trying the demo, make a prediction: if two steps say “four plus four” but another route says “six,” where should the disagreement go?
A robot map held together by springs.
A robot records two steps of four units each. A second route measures the separation from A to C. When the routes disagree, the map settles like a network of springs competing for their preferred lengths.
Drag the sky-blue anchor A to shift the whole map. The whiskers under B and C show position ±1 standard deviation relative to that fixed anchor.
- Two-route disagreement
- 2.00 units
- Reported position spread at C
- σ = 0.816
- First / second step error
- -0.667 / -0.667
- Loop's fitted error
- 0.667
A stronger loop pulls A and C closer to its requested separation. Move the anchor to shift the entire map while keeping every fitted separation unchanged.
The positions are xA, xB, xC; d is the loop reading and w its effective weight. The first step has precision w1 and noise standard deviation 1/√w1; the second has precision one and standard deviation one. Minimizing E gives spring equilibrium and the Gaussian map estimate. A is fixed exactly; σ comes from the inverse of the remaining precision matrix.
The network distributes the mismatch according to the weights. A stiff connection gives up little; softer ones deform more. In the map, a precise observation pulls harder and less precise observations absorb more of the residual error.
With all three weights equal, the two four-unit steps each shorten by
The matrix shared by three workshops
We can pack the network into a matrix
The superscript
In mechanics,
| Shared network ingredient | Spring structure | Gaussian map | Resistor network |
|---|---|---|---|
| Node value | Displacement | Estimated position | Voltage |
| Edge weight | Stiffness | Measurement precision | Conductance |
| Assembled | Stiffness matrix | Precision matrix | Conductance Laplacian |
“Laplacian” is the name for this matrix of weighted differences. Each workshop assembles it from local connections and uses it to solve a global balance.
Civil engineering extends the assembly idea to trusses and finite elements, where each element contributes a small stiffness matrix to the structure. Estimation assembles local information in the same spirit. A network can carry directional resistance that a single scalar strength could never describe.
Why the map needs an anchor
Notice what happens when we add the same constant to every position. Every difference
Mechanics calls this a rigid translation. Circuits let us choose a ground potential. Mapping chooses an origin. Mathematically, there is a direction in which the unanchored network has zero stiffness and zero information.
Fixing an anchor removes that freedom. In the demo, moving the anchor slides the map while preserving all its internal compromises. A precise relative map can still have an arbitrary absolute origin.
A copied measurement is a counterfeit spring
Try counting the loop reading twice. The solver adds another spring in the same place. The map shifts farther toward that reading, and its reported uncertainty shrinks.
But the robot has learned nothing new.
This is where Epistemic Physics brings lineage into the workshop. A tracelet is an elementary evidence contribution; its lineage records where it came from. Two messages carrying the same observation still descend from one source event. A fleet of robots exchanging estimates needs that distinction just as much as a scientific community exchanging claims.
Distinct observations can also share errors: two sensors may use the same calibration, or two maps may inherit the same earlier measurements. When those correlations are unknown, methods such as covariance intersection combine estimates while accounting for that uncertainty about their dependence. Julier and Uhlmann explore this in SLAM.
Lineage and covariance therefore answer complementary engineering questions: Did this contribution arrive before? And how do its errors move with the others? Our one trial, many echoes field trip follows the first question in detail.
Chemical engineering: composition needs an inventory
At the chemical bench, put amounts
That should sound familiar. A ratio tells us where the system sits. Its inventory helps tell us how far a new dose can push it.
The Henderson-Hasselbalch equation reads
Here
pH is an affine rapidity coordinate: a scaled rapidity plus an offset. The concentration-ratio equation is given in IUPAC’s chemical terminology reference.
For a fixed-volume buffer, add a small amount
This is an amount-based buffer capacity. Define the balanced amount
For a fixed inventory, balance maximizes resistance to a pH change. Near either end, the remaining minority ingredient is easily exhausted. Try the same dose in a balanced mixture and an unbalanced one.
Give a buffer a little shove.
Add the same small dose of acid or base. Does a balanced mixture move as far in pH as one that is already mostly acid or mostly base?
- pH
- 7.000
- Rapidity ρ
- 0.000
- Epistemic mass
- 20.00 mmol
- Buffer capacity
- 11.51 mmol/pH
One curve, two rulers: the pH values on the left and rapidity values on the right mark the same mixtures. At pH 7, rapidity is zero.
The two curves coincide: both equal 4p(1 − p), where p is the fraction in the base form. Here each is 1.000 of its maximum. Capacity reaches 11.51 mmol/pH and mass reaches 20 mmol at balance.
Start with equal amounts, then try a mixture away from balance. At a fixed total amount, both buffer capacity and epistemic mass reach their maximum at a 50:50 mixture.
Here a and b are the acid and base amounts. Added strong base converts HA to A⁻; added strong acid does the reverse. The model holds volume fixed, uses pKa = 7, and neglects water's contribution. Capacity means the local amount of added base per unit pH: ln(10) ab/(a + b). The shared curve compares their shapes after dividing out their different units and maxima. Additions stop before either component falls below 1%.
This suggests a chemical engineer’s reading of an evidence state: carry the composition and the inventory. In process control, a ratio may look perfectly steady while the reservoir that supports it is quietly running dry.
A drawer for Gamma and the Beta extensions
The richer distributions become useful when we start asking different questions about the inventory. Suppose two independent uncertain positive amounts satisfy
where
The odds
Now imagine a process that rescales every candidate odds value by a positive factor
This translates each candidate rapidity by
If fresh binary observations follow that transport, their likelihood multiplies the density by powers of
Here is a concrete place for those extensions to earn their shelf space: an odds-changing process followed by observations. More elaborate sequences of processes can need richer families again. We can choose the distribution to match the operation we actually want our device to perform.
What would we build next?
A robot could carry a map whose observations retain their lineage. When another robot shares a map fragment, it could distinguish new measurements from familiar measurements taking a longer route home. The spring-network demo is a little blueprint for how duplicated evidence can distort the result.
A chemical controller could track both an operating ratio and the amount available to resist disturbances. The controller might move its sensors away from saturation, keeping them in the region where their readings remain informative.
A civil monitoring system could represent uncertainty about a structure in the same sparse pattern used for the structure’s mechanical model. A new strain measurement would then stiffen particular directions in the estimate, while a poorly observed mode could remain loose.
A navigation system could assign different memory times to different kinds of evidence: a slowly changing instrument bias, rapidly changing motion, and a stable landmark each deserve a different relationship with the past. The circuit analogy makes those timescales tangible; the Kalman equations turn the choice into a prediction-and-correction calculation.
There is also a direct route into reliability engineering. A component’s pass/fail record already fits the Beta notebook on our first bench. Keeping its trial amount alongside its estimated success probability lets a controller distinguish an extensively tested component from an unfamiliar one with the same estimated performance. NIST’s reliability handbook describes this Beta/binomial pairing and Gamma models for failure processes.
The interesting design question is often where to spend the next trial. Inspect the uncertain joint? Turn the camera? Retune the receptor? Revisit the landmark? Once an action changes what a system can learn, sensing itself becomes part of the engineering problem.
We came into the workshop with two columns of evidence. We leave with springs that fuse measurements, circuits that remember, maps that negotiate, and buffers whose balance determines how much they can absorb. There are plenty of spare parts on the bench. Pick a system, give its belief something to push against, and see what moves.