docs(adr): ADR-180 — through-wall camera↔CSI hand-off demo (Behind the Wall)#1106
Open
ruvnet wants to merge 1 commit into
Open
docs(adr): ADR-180 — through-wall camera↔CSI hand-off demo (Behind the Wall)#1106ruvnet wants to merge 1 commit into
ruvnet wants to merge 1 commit into
Conversation
…he Wall") Proposed design for the HTML demo: camera-supervised CSI model infers a full skeleton, hands off camera→RF when you walk behind a wall, and keeps inferring the skeleton through the wall (S3 + C6 mmWave + Pi5 nexmon multistatic fusion + AETHER re-ID). Dead-reckoning Kalman smoother (reuses pose_tracker.rs) keeps the figure fluid through dropped CSI with bounded extrapolation → LOST, never a phantom. Honesty mechanism: a far-side camera (cognitum-v0) provides ground truth behind the wall so the through-wall skeleton PCK is MEASURED + published (metric-locked, ADR-173), not claimed. Reuses ADR-079 supervision, the multistatic fuser, the calibration crate, and the Observatory UI — new code is a hand-off module + dead-reckoning smoother + a single-file HTML viewer. Co-Authored-By: claude-flow <ruv@ruv.net>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
ADR-180 — "Behind the Wall" demo design
Detailed design for the requested HTML demo: you stand in front of the laptop (camera + CSI agree on your skeleton), walk behind a wall (camera goes blind), the CSI model keeps inferring your skeleton through the wall, then hands back when you return — using the ESP32-S3 (COM9), ESP32-C6 + MR60BHA2 mmWave (COM12), Pi 5 Broadcom nexmon CSI (cognitum-v0), and the laptop camera.
What the ADR specifies
pose_tracker.rs) runs at a fixed 30 Hz decoupled from CSI arrival — predict-only on dropped frames so the figure glides instead of jumping/jittering, with bounded extrapolation + confidence decay →LOST(never a phantom that coasts forever)./dev/video*nodes) records ground-truth pose behind the wall, and the through-wall skeleton is scored against it with the metric-locked PCK harness (ADR-173). The number is published, good or bad. The inferred skeleton renders translucent with per-joint confidence; predicted frames are flaggeddead_reckoned.CAMERA → HANDOFF_OUT → RF_INFERRED → HANDOFF_IN → CAMERA (+ LOST), aHandoffFrameoutput contract, a single-file vanilla HTML viewer mirroringui/observatory/, and a 5-phase falsifiable plan with measured acceptance criteria.Reuses existing, already-reviewed components (multistatic fuser, ADR-079 supervision, calibration crate, Kalman tracker, Observatory UI) — new code is a hand-off module + dead-reckoning smoother + the HTML page. Signal-path proof untouched.
Status: Proposed. This is the design; implementation is P1-P5 in the ADR. Want me to start P1 (3-source capture wiring) next?
🤖 Generated with claude-flow