Vv/test automation

[vishnuv688]

What & why

Type of change

• Bugfix (non-breaking change which fixes an issue)
• New feature (non-breaking change which adds functionality)
• Polish (an improvement to an existing feature)
• Breaking change (existing behavior changes for users)
• Documentation
• Internal (build, CI, dependencies, tooling)

Packages touched

• shared (types and contracts)
• core (framework-agnostic capture/reporting)
• service (WebdriverIO adapter)
• nightwatch-devtools (Nightwatch adapter)
• selenium-devtools (Selenium adapter)
• backend (server)
• app (UI)
• script (page-injected runtime)

Notes for reviewers

Screenshots / recordings

[greptile-apps]

Greptile Summary

This PR adds a cross-adapter trace verification and visual-regression harness.

• Adds committed trace fixtures and snapshot-based capture summaries for five adapter/runner combinations.
• Adds fixture regeneration, trace-serving, and player visual-regression utilities.
• Adds CI verification plus Nightwatch Cucumber and trace-mode example configuration.
• Adds visual baselines and the visual-service development dependency.

Confidence Score: 4/5

The PR appears safe to merge, with a non-blocking gap where missing fixtures for ready matrix entries can silently remove adapter coverage.

The committed ready fixtures are present and the new harness exercises them, but fixture presence is not enforced, so future matrix changes can pass CI without running the intended parity assertion.

Files Needing Attention: test/capture/capture-parity.test.ts

Important Files Changed

Filename	Overview
.github/workflows/verify.yml	Adds a pull-request gate that installs dependencies, lints the harness, and runs capture-parity verification.
test/capture/capture-parity.test.ts	Validates committed traces through the production reader, but silently skips ready entries when their fixture is missing.
test/capture/matrix.ts	Centralizes regeneration commands and output paths for five ready combinations and one planned Nightwatch Cucumber combination.
test/regen.ts	Cleans adapter outputs, runs examples in trace mode, and refreshes committed golden fixtures with explicit failure reporting.
test/capture/summarize.ts	Produces deterministic structural summaries of reconstructed traces for snapshot comparison.
test/visual/player.e2e.ts	Serves each fixture and captures full-player and per-panel visual snapshots.
test/visual/wdio.conf.ts	Configures single-instance headless Chrome visual testing and committed baseline lookup.
examples/nightwatch/cucumber/nightwatch.cucumber.conf.cjs	Adds a Nightwatch Cucumber example while explicitly retaining the known trace-export limitation.
package.json	Exposes verification, regeneration, and visual-test commands and adds the visual-service tooling dependency.

Flowchart

%%{init: {'theme': 'neutral'}}%%
flowchart LR
  E[Adapter examples] -->|fixtures:regen| Z[Committed trace.zip fixtures]
  Z --> R[Backend trace reader]
  R --> S[Capture summaries]
  S --> V[Vitest snapshots]
  R --> B[Fixture-backed server]
  B --> P[Trace player]
  P --> I[Visual baselines]
  V --> C[CI verify gate]

Loading

_{Reviews (1): Last reviewed commit: "test(visual): enforce WebDriver Classic ..." | Re-trigger Greptile}

[greptile-apps]

Ready fixtures silently skip

A ready matrix entry without its committed test/fixtures/<id>/trace.zip causes this entire suite to be skipped while pnpm verify still succeeds, removing capture-parity coverage for that adapter without failing CI. Require fixtures for ready entries, reserving skip behavior for entries explicitly marked as planned.

Note: If this suggestion doesn't match your team's coding style, reply to this and let me know. I'll remember it for next time!