The Multimodal Sensor Bay
You are here · Protocol 09
Shift briefing · Multi-Sensor Bay
A technician must identify a label on a partially obscured unit. The camera view has glare, the spoken description is noisy, and the OCR transcript contains a similar-looking code.
Read before the shift. It tells you what is at stake, never how to do it.
What you practise
Combine image, audio, and text signals while recognising modality-specific failure modes.
- Multimodal input
- OCR
- transcription
- ambiguity
- sensor limitations
Discover Find what is really going on before acting on it.
The facility for this shift
3 rooms, 4 stations, two hands.
- 01Camera BoothCamera booth
- 02Audio RoomAudio console
- 03Evidence RoomOCR station · Evidence board
Compromised Signal · sealed
Something in this shift will change, and the briefing will not tell you what. You find it from the evidence, or your after-action review shows you where it was.
How the shift is assessed
3 criteria · 0 to 6
Scored from what you did: the evidence you checked, the stations you operated, the artifacts you produced and the gates you passed. The criteria are revealed in your after-action review, not before.
Capabilities evidenced
- PerceptionNotices relevant signals, discrepancies, provenance, and system state.In 13 of 48
- JudgmentChooses proportionate actions and knows when to verify, abstain, or escalate.In 27 of 48
- ReliabilityTests, reproduces, validates, recovers, and produces consistent outcomes.In 39 of 48
Chamber I · The Tool
Know what a tool can be trusted with, and check before you rely on it.
Understand AI tools, evidence, context, prompt construction, modality, oversight, privacy and tool choice.
Play Protocol 09 in first person, with the clock running.