Skip to content

Record why the cluster capture needs no verify gate - #527

Closed
Rachael-Graham wants to merge 1 commit into
mainfrom
gate-cluster-capture
Closed

Rachael-Graham wants to merge 1 commit into
mainfrom
gate-cluster-capture

Conversation

@Rachael-Graham

@Rachael-Graham Rachael-Graham commented Sep 23, 2026 •

Copy link
Copy Markdown
Contributor

Comments only. The parsed workflow is byte-identical to main.

The gate this PR originally added was unnecessary. It claimed update:* consults no tolerance. It does. node_modules/playwright/lib/program.js presets a bare --update-snapshots to changed, and matchers/expect.js writes under that mode only when the comparison returns an error — the comparison that applies playwright.config.ts's maxDiffPixelRatio: 0.01. Only --update-snapshots=all falls back to a raw byte comparison.

Evidence from the two runs either side of #526.

Run Baselines in main Rewritten PR opened
19:30, produced #526 macOS renders 4 of 6 — dashboard passed, agents and substrate failed #526
20:21, after #526 merged Linux renders none none

The second run stood up a fresh kind cluster, so it had a new ReplicaSet hash, a new pod IP and a moving read N ago line, and committed none of them. The recurring contentless PR stopped when the Linux baselines landed, not for want of a gate.

What is left here. The reasoning above, recorded on the capture step, plus two corrections to the cluster job's header comment: a refresh PR that also edits a spec does re-trigger this workflow, since tests/** is on the path filter — #523 edited chat.spec.ts and its merge started the run that produced #526 — and the hosted runner is no longer unproven.

🤖 Generated with Claude Code

@github-actions

github-actions Bot commented Sep 23, 2026 •

Copy link
Copy Markdown

Docs preview

Link Points at
Branch preview The newest push to this branch. Updates in place.
Commit preview 33b72bc only. Frozen.

Both are uploaded Worker versions and serve no production traffic.

The capture step needs no verify gate. A bare `--update-snapshots` presets
`changed` in the pinned 1.63.0, which rewrites only baselines that fail the
comparison, and the comparison applies `maxDiffPixelRatio: 0.01`.

Also corrects the trigger comment: a refresh PR that edits a spec does
re-trigger this workflow, and the hosted runner is no longer unproven.

Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
Signed-off-by: Rachael Graham <rachael.graham@solo.io>
@Rachael-Graham Rachael-Graham changed the title Capture the cluster baselines only when a verify fails Record why the cluster capture needs no verify gate Sep 24, 2026
@Rachael-Graham
Rachael-Graham deleted the gate-cluster-capture branch September 24, 2026 17:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant