Skip to content

feat: add e2e testing support as a testing studio - #95

Merged
hurali97 merged 30 commits into
mainfrom
e2e-testing
Nov 13, 2026
Merged

hurali97 merged 30 commits into
mainfrom
e2e-testing

Conversation

@hurali97

@hurali97 hurali97 commented Nov 10, 2026 •

Copy link
Copy Markdown
Collaborator

Description

This adds a first-class support for e2e testing framework. Users with an e2e setup can now use the testing studio and record their tests by interacting with their app. They can also ask an agent to record a test for them.

Testing Strategy

  • Tested on Expo App
  • Tested on Blue Sky

@vercel

vercel Bot commented Nov 10, 2026 •

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated
mobile-dev Error Error Nov 13, 2026 12:34pm UTC

Request Review

github-actions Bot added a commit that referenced this pull request Nov 13, 2026
github-actions Bot added a commit that referenced this pull request Nov 13, 2026
@github-actions

github-actions Bot commented Nov 13, 2026 •

Copy link
Copy Markdown

Visual regression (codex)

No visual changes from main.

@hurali97 hurali97 changed the title E2e testing feat: add e2e testing support as a testing studio Nov 13, 2026
@hurali97
hurali97 marked this pull request as ready for review November 13, 2026 12:14

Copilot AI left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🟡 Changes recommended

Unresolved critical path-validation and singleton-recorder issues, along with device attachment and release races, can run unintended code or act on the wrong application state.

4 open issues
What changed in this PR

Adds end-to-end testing support across the Mobile Dev plugin, including a Testing workspace, manual and agent-driven recording, test editing and execution workflows, project draft persistence, and iOS/Android device integration.

Changes:

  • Adds Testing panel layouts, recorder overlays, cascading menus, source editing, syntax highlighting, and device-layout handling.
  • Adds MCP tools and server-side support for project discovery, draft storage, test execution, device sessions, and agent-driven recording.
  • Adds shared skills, telemetry, documentation, and broad unit, UI, host, and end-to-end test coverage.
File Description
tooling/​plugin-hosts.mjs Includes the testing skill in shared plugin packages.
tooling/​hosts/​hosts.spec.ts Adds host-level Testing panel layout and device-discovery coverage.
packages/​ui/​test/​workspace-devices.test.ts Tests automatic device layout resolution.
packages/​ui/​test/​testing-panel.test.ts Tests recording, saving, running, and progress behavior.
packages/​ui/​test/​test-source-suggestions.test.ts Tests editor completion suggestions.
packages/​ui/​test/​stored-test-steps.test.ts Tests stored-test source editing and step operations.
packages/​ui/​test/​react-ui.test.ts Adds Testing panel integration to UI fixtures.
packages/​ui/​test/​popover-placement.test.ts Tests popover and submenu placement.
packages/​ui/​test/​code-highlight.test.ts Tests source highlighting and changed-line detection.
packages/​ui/​test/​assertion-menu-ui.test.ts Tests assertion menu interactions and timeout forms.
packages/​ui/​src/​workspace-tools.ts Registers and manages the Testing panel.
packages/​ui/​src/​workspace-devices.ts Supports deferred automatic layout completion.
packages/​ui/​src/​test-source-suggestions.ts Implements test-source completions.
packages/​ui/​src/​telemetry.ts Adds platform-scoped UI timing metrics.
packages/​ui/​src/​style.css Styles testing previews, editors, marks, and controls.
packages/​ui/​src/​stored-test-steps.ts Provides stored-test parsing and editing helpers.
packages/​ui/​src/​simulator-panel.ts Connects the recorder to device trees and mirror input.
packages/​ui/​src/​popover-placement.ts Implements viewport-aware menu placement.
packages/​ui/​src/​device-workspace.ts Connects device discovery to layout settling.
packages/​ui/​src/​components/​test-recorder-overlay.tsx Adds recorder outlines and element menus.
packages/​ui/​src/​components/​simulator-view.tsx Renders the recorder overlay over simulator views.
packages/​ui/​src/​components/​cascading-menu.tsx Implements portal-based cascading menus and keyboard behavior.
packages/​ui/​src/​code-highlight.ts Tokenizes generated test source and detects changed lines.
packages/​skills/​README.md Documents distribution of the testing skill.
packages/​skills/​mobile-dev-testing/​SKILL.md Defines the agent-driven end-to-end recording workflow.
packages/​skills/​mobile-dev-testing/​agents/​openai.yaml Adds skill metadata and tool dependency information.
packages/​shared/​src/​test-drafts.ts Defines validated persisted recording drafts.
packages/​shared/​src/​telemetry.ts Adds the Testing telemetry surface.
packages/​shared/​src/​screen-annotations.ts Extends screen metadata and coordinate scaling.
packages/​shared/​src/​panel-target.ts Adds recordable-device validation and platform helpers.
packages/​mcp-app/​src/​components/​workspace.tsx Adds the Testing tool and responsive workspace layout.
packages/​core/​test/​testing-projects.test.ts Tests project discovery, test-file safety, and staging.
packages/​core/​test/​testing-drafts.test.ts Tests draft persistence, filtering, and pruning.
packages/​core/​test/​testing-device.test.ts Tests runner-tree projection and device sessions.
packages/​core/​test/​testing-agent-panel.test.ts Tests agent recording adoption and panel handoff.
packages/​core/​test/​react-native-inspector.test.ts Tests nested React Native text extraction.
packages/​core/​test/​plugin.test.ts Tests recovery from stale accessibility bridges.
packages/​core/​test/​mobile-dev-skill.test.ts Verifies testing-skill guidance and packaging.
packages/​core/​test/​jsdom-env.ts Extends the UI test environment with DOM geometry shims.
packages/​core/​src/​testing-tools.ts Registers Testing project, draft, device, and run tools.
packages/​core/​src/​testing-drafts.ts Implements atomic draft storage and retention.
packages/​core/​src/​testing-device.ts Manages runner snapshots, actions, and device sessions.
packages/​core/​src/​telemetry.ts Adds server-side agent screen-read metrics.
packages/​core/​src/​react-native-snapshot.js Flattens nested React Native text content.
packages/​core/​src/​plugin.ts Registers Testing services and shutdown cleanup.
packages/​core/​src/​baguette.ts Recovers from successful but stale accessibility responses.
packages/​core/​src/​app-flow-host.ts Exposes vendored agent-device loading for testing.
package.json Adds a local build and package installation shortcut.
docs/​telemetry.md Documents Testing instrumentation and privacy boundaries.
docs/​agent-recording.md Documents agent-driven recording architecture and behavior.
apps/​claude/​plugin-host.json Ships the testing skill with the Claude plugin.

Review effort: Lite

Comment thread packages/core/src/testing-tools.ts Resolved
Comment thread packages/ui/src/simulator-panel.ts Resolved
Comment thread packages/core/src/testing-device.ts Resolved
Comment thread packages/core/src/testing-device.ts Resolved
@hurali97
hurali97 merged commit 3b9b596 into main Nov 13, 2026
14 of 15 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants