Skip to content

feat(o11y): execute real inputs through Planner-selected backend plans - #525

Merged
zzylol merged 11 commits into
mainfrom
feat/o11ybench-execution
Sep 8, 2026
Merged

feat(o11y): execute real inputs through Planner-selected backend plans#525
zzylol merged 11 commits into
mainfrom
feat/o11ybench-execution

Conversation

@zzylol

@zzylol zzylol commented Sep 8, 2026

Copy link
Copy Markdown
Contributor

Run supplied o11ybench inputs through the control plane's normal Planner/cost selection and production data plane, preserving query occurrences, labels and timestamps. Require version-2 complete cost evidence and record actual responses as warm, exact fallback or failed; no winner override or synthetic workload replacement is supplied.

Before this PR, offline binding did not prove that samples were ingested or queries executed. After this PR, the runner installs the selected artifact, sends Remote Write batches, waits for an explicit finite-input completion barrier, and queries every original occurrence. Forwarded responses carry a backend-owned exact-fallback header and cannot count as warm execution.

The completion barrier seals Remote Write before queuing FIFO worker barriers. Workers publish trailing panes before acknowledging. Processing errors and rejected sink outputs remain failures across repeated drains. Valid writes after sealing return HTTP 409; another input generation requires a fresh backend process. This is an explicit finite-replay operation, not a live-ingestion watermark or proof that every closed pane matches every query window.

Validation on the integrated Planner revision abb2f20: 662 control-plane unit tests, 3 Rust drain/receiver regressions, 4 sink tests, 1 fallback-marker regression and 1 production Remote Write wire test passed; 4 Python replay tests passed; git diff --check passed. Integrated #528's counter-safety changes; its process checks remain separate.

Stack: merged #524 and #528 plus deployment/PromQL foundations. #526 adds paired Prometheus comparisons and resource reporting. This PR adds no retained raw-query store, typed logical operator runtime or hybrid execution implementation. A full real-corpus matched run, calibrated costs and reproducible performance/resource benefits are not claimed by these infrastructure tests. Input provenance and raw execution artifacts are preserved for that separate acceptance experiment.

@zzylol
zzylol marked this pull request as ready for review September 8, 2026 20:15
@zzylol
zzylol changed the base branch from codex/empirical-o11y-322 to main September 8, 2026 20:51
@zzylol
zzylol merged commit 472de6e into main Sep 8, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant