Repository navigation
feat: add e2e testing support as a testing studio - #95
Merged
Merged
Conversation
|
The latest updates on your projects. Learn more about Vercel for GitHub.
|
Visual regression (codex)No visual changes from main. |
hurali97
marked this pull request as ready for review
November 13, 2026 12:14
There was a problem hiding this comment.
🟡 Changes recommended
Unresolved critical path-validation and singleton-recorder issues, along with device attachment and release races, can run unintended code or act on the wrong application state.
4 open issues
What changed in this PR
Adds end-to-end testing support across the Mobile Dev plugin, including a Testing workspace, manual and agent-driven recording, test editing and execution workflows, project draft persistence, and iOS/Android device integration.
Changes:
- Adds Testing panel layouts, recorder overlays, cascading menus, source editing, syntax highlighting, and device-layout handling.
- Adds MCP tools and server-side support for project discovery, draft storage, test execution, device sessions, and agent-driven recording.
- Adds shared skills, telemetry, documentation, and broad unit, UI, host, and end-to-end test coverage.
| File | Description |
|---|---|
| tooling/plugin-hosts.mjs | Includes the testing skill in shared plugin packages. |
| tooling/hosts/hosts.spec.ts | Adds host-level Testing panel layout and device-discovery coverage. |
| packages/ui/test/workspace-devices.test.ts | Tests automatic device layout resolution. |
| packages/ui/test/testing-panel.test.ts | Tests recording, saving, running, and progress behavior. |
| packages/ui/test/test-source-suggestions.test.ts | Tests editor completion suggestions. |
| packages/ui/test/stored-test-steps.test.ts | Tests stored-test source editing and step operations. |
| packages/ui/test/react-ui.test.ts | Adds Testing panel integration to UI fixtures. |
| packages/ui/test/popover-placement.test.ts | Tests popover and submenu placement. |
| packages/ui/test/code-highlight.test.ts | Tests source highlighting and changed-line detection. |
| packages/ui/test/assertion-menu-ui.test.ts | Tests assertion menu interactions and timeout forms. |
| packages/ui/src/workspace-tools.ts | Registers and manages the Testing panel. |
| packages/ui/src/workspace-devices.ts | Supports deferred automatic layout completion. |
| packages/ui/src/test-source-suggestions.ts | Implements test-source completions. |
| packages/ui/src/telemetry.ts | Adds platform-scoped UI timing metrics. |
| packages/ui/src/style.css | Styles testing previews, editors, marks, and controls. |
| packages/ui/src/stored-test-steps.ts | Provides stored-test parsing and editing helpers. |
| packages/ui/src/simulator-panel.ts | Connects the recorder to device trees and mirror input. |
| packages/ui/src/popover-placement.ts | Implements viewport-aware menu placement. |
| packages/ui/src/device-workspace.ts | Connects device discovery to layout settling. |
| packages/ui/src/components/test-recorder-overlay.tsx | Adds recorder outlines and element menus. |
| packages/ui/src/components/simulator-view.tsx | Renders the recorder overlay over simulator views. |
| packages/ui/src/components/cascading-menu.tsx | Implements portal-based cascading menus and keyboard behavior. |
| packages/ui/src/code-highlight.ts | Tokenizes generated test source and detects changed lines. |
| packages/skills/README.md | Documents distribution of the testing skill. |
| packages/skills/mobile-dev-testing/SKILL.md | Defines the agent-driven end-to-end recording workflow. |
| packages/skills/mobile-dev-testing/agents/openai.yaml | Adds skill metadata and tool dependency information. |
| packages/shared/src/test-drafts.ts | Defines validated persisted recording drafts. |
| packages/shared/src/telemetry.ts | Adds the Testing telemetry surface. |
| packages/shared/src/screen-annotations.ts | Extends screen metadata and coordinate scaling. |
| packages/shared/src/panel-target.ts | Adds recordable-device validation and platform helpers. |
| packages/mcp-app/src/components/workspace.tsx | Adds the Testing tool and responsive workspace layout. |
| packages/core/test/testing-projects.test.ts | Tests project discovery, test-file safety, and staging. |
| packages/core/test/testing-drafts.test.ts | Tests draft persistence, filtering, and pruning. |
| packages/core/test/testing-device.test.ts | Tests runner-tree projection and device sessions. |
| packages/core/test/testing-agent-panel.test.ts | Tests agent recording adoption and panel handoff. |
| packages/core/test/react-native-inspector.test.ts | Tests nested React Native text extraction. |
| packages/core/test/plugin.test.ts | Tests recovery from stale accessibility bridges. |
| packages/core/test/mobile-dev-skill.test.ts | Verifies testing-skill guidance and packaging. |
| packages/core/test/jsdom-env.ts | Extends the UI test environment with DOM geometry shims. |
| packages/core/src/testing-tools.ts | Registers Testing project, draft, device, and run tools. |
| packages/core/src/testing-drafts.ts | Implements atomic draft storage and retention. |
| packages/core/src/testing-device.ts | Manages runner snapshots, actions, and device sessions. |
| packages/core/src/telemetry.ts | Adds server-side agent screen-read metrics. |
| packages/core/src/react-native-snapshot.js | Flattens nested React Native text content. |
| packages/core/src/plugin.ts | Registers Testing services and shutdown cleanup. |
| packages/core/src/baguette.ts | Recovers from successful but stale accessibility responses. |
| packages/core/src/app-flow-host.ts | Exposes vendored agent-device loading for testing. |
| package.json | Adds a local build and package installation shortcut. |
| docs/telemetry.md | Documents Testing instrumentation and privacy boundaries. |
| docs/agent-recording.md | Documents agent-driven recording architecture and behavior. |
| apps/claude/plugin-host.json | Ships the testing skill with the Claude plugin. |
Review effort: Lite
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.


Description
This adds a first-class support for e2e testing framework. Users with an e2e setup can now use the testing studio and record their tests by interacting with their app. They can also ask an agent to record a test for them.
Testing Strategy