Move to ask a better question
Move a sensor, combine cues, and discover what the next reading can reveal.
Imagine inspecting a sculpture in a dark room. You could turn up your flashlight. You could walk around the sculpture. Those actions help in different ways: one can make a signal easier to measure; the other can make rival interpretations predict different signals.
Nervous systems do both. Active sensing means acting to shape the sensory input you receive. Sometimes the action creates a signal, as when an animal emits a sound or electric field. Sometimes it changes the viewpoint, the sampling location or the timing.
In Epistemic Physics language, this takes us upstream of accumulating trials. Before asking how a tracelet changes a belief, ask which action makes the next tracelet worth obtaining.
A fish that moves to feel
Weakly electric fish produce an electric field and sense how their surroundings alter it. In a refuge-tracking experiment, Stamper, Roth, Cowan and Fortune varied illumination and water conductivity while fish followed a moving shelter. In darkness, fish added whole-body oscillations; those oscillations grew as electrosensory salience decreased. Tail bends appeared only in dark trials. The shelter remained inside sensing range, so simply reaching previously unsensed space could not explain the behavior. Tracking gain remained similar across conditions, while the extra oscillations increased tracking error. Read the original 2012 study.
There is a useful lesson here: an animal can change the stream arriving at its sensors by changing how it moves. The geometry of observation belongs inside the perception problem.
Let’s build a tiny world where we can separate two effects that real movements can combine.
Turn up the signal, or change the question?
Suppose an object lies at one of two possible positions,
where
At the center, both worlds predict exactly the same reading:
Increasing
The two operations line up like this:
| Amplify at a fixed location | Move to another location |
|---|---|
| Change | Change |
| Enlarge a difference already present | Find a place where predictions differ |
| At | At |
| Benefit depends on what happens to noise | Benefit depends on the spatial signal model |
Our demo holds the fresh measurement noise fixed when changing gain. Under that assumption, amplifying an existing difference helps. If the same gain amplified all noise by the same factor, that signal-to-noise benefit would disappear.
Try this sequence: double the gain at the center. Then move the sensor. Finally, keep your position fixed and enable the shared offset. Which sampling route becomes better, and why?
Plant four probes
Help two look-alike worlds disagree. Move the gold sensor, plant four probes, then reveal the expected evidence.
0 of 4 probes planted. Aim for 8 nats of expected evidence.
Explore gain, standard routes, and the mathematics
- Sensor position
- 0.00
- Reading A / B
- 0.25 / 0.25
- Local slope A / B
- 1.0 / -1.0
- Reading difference
- 0.00
Spend the same four readings
Compare staying at the crossing, taking four fresh readings at your point, or taking two on each side. The bars show expected evidence separating A from B, in nats. One nat is one unit of natural-log likelihood ratio.
Chosen model: signal = gain × (position − object)², objects at −0.5 and +0.5. Each reading has independent Gaussian noise with standard deviation 0.6. The optional offset is one zero-mean Gaussian draw, standard deviation 2, shared across all four readings. Curves show noiseless predictions; bars average over noise analytically. Reading budgets match; travel distance and energy do not.
Open the active-sensing experiment in the playground.
The curves are candidate predictions, so neither is secretly designated as the observed truth. The bars show an expected separation between their observation distributions. They let us compare sensing plans before drawing noisy data.
A changing signal can answer a different question
At the center, the signal slopes, their rates of change with position, point in opposite directions:
A single center reading hides the difference. Two nearby positions expose it. If the sensor follows a known path
Spatial shape becomes a temporal signal. Moving faster changes that temporal signal even along the same route. How a biological sensor responds then depends on its own filtering and time scales. The quadratic demo isolates the spatial part; the fish study motivates asking how actual movements reshape the full stream.
This is a particularly playful connection to evidence geometry: a learner can change the direction of the evidence it expects to receive by choosing a measurement context. Simply accumulating more readings in a blind spot might never resolve the ambiguity.
Count readings, then inspect their shared history
Let the
The term
That shared offset is a simple source lineage. Four measurements have four fresh errors, but all inherit one calibration condition. Labeling each reading with a new identifier would not remove this dependence.
Let
Here
The first sum rewards differences between predictions. The second term discounts a difference that a common offset could explain. The derivation comes from the covariance matrix
Now compare four readings at
- With only fresh noise, both plans have the same sum of squared differences and therefore tie.
- With a shared offset, the one-sided plan loses separation. The two-sided plan has
, so its differences survive the offset unchanged. - At
, both plans return to the blind spot.
The movement benefit follows from the measurement model. The comparison matches reading count; traveling between positions could cost extra energy or time. A decision model can add those costs explicitly and ask how much separation each route buys.
When vision and touch vote together
A second way to improve sensing is to combine different cues. Suppose vision estimates an object’s height as
For unbiased, independent errors, the minimum-variance weighted estimate is
The quantities
Ernst and Banks tested visual and haptic estimates of object height while varying visual uncertainty. Their results were consistent with weighting the cues according to their relative precision under the tested conditions. Read their 2002 Nature paper.
For a numerical example, let vision say
Place this beside the evidence-cone calculation:
| Precision-weighted scalar estimate | Two-pool Beta mean |
|---|---|
| Retain location and total precision | Retain balance and total shape amount |
| Independent precision contributions add | Distinct trial contributions add under the chosen likelihood |
The common operation is weighted averaging. The weights have different meanings and units. Gaussian precision is inverse squared measurement units; Beta shape amounts are dimensionless. A cue estimate becomes a Beta trial contribution only after defining an observation model that supports that conversion.
If the cue errors share a common cause, their covariance changes the optimal weights and the combined variance. The same source-identity question from our moving sensor returns: which part of the apparent agreement is fresh information, and which part is shared?
Three expeditions to try next
Choose a path by predicted separation. Give a learner a budget of readings and let it compare possible next positions. An action can be selected because it separates its current leading explanations. Add a distance cost and see when small oscillations beat long excursions.
Learn the sensor’s reliability. Our cue variances were supplied. A richer learner could estimate them from experience, distinguishing a drifting calibration from independent noise. Then the weight assigned to a cue becomes a learned state with its own malleability.
Carry lineage through perception. A visual and tactile tracelet may both come from the same object encounter. Preserve that encounter’s identity while recording the separate modalities and errors. Ask which combinations deserve an increased trial amount, and which primarily clarify a shared hidden cause.
In all three expeditions, action and inference become a conversation. The learner forms a question, movement makes a new observation possible, and the resulting tracelet changes what the learner can ask next.