Control your iPhone from Claude through the macOS iPhone Mirroring app
17 tools with generally clear naming (verb-first: screenshot, tap, swipe, type_text, press_key, etc.) and reasonable descriptions (avg ~120 chars). All tools have input schemas with typed parameters. However, critical gaps: (1) No output schemas documented anywhere, LLMs cannot plan downstream calls or extract return values; (2) Many parameter descriptions are minimal (e.g., 'X coordinate in device points' lacks range/constraint info); (3) No error handling guidance, tools like 'tap' and 'swipe' can fail (CoordinatesOutOfRange, MirroringPaused) but descriptions don't explain recovery; (4) No idempotency or confirmation patterns for destructive ops (start_recording, stop_recording, home, app_switcher); (5) explore_app is complex (4 params, max_screens/max_actions/max_depth) but lacks guidance on when to use vs. simpler tools. Naming is solid (verb_noun pattern), but schema and error documentation are weak.
Open the iPhone App Switcher.
Go back by tapping the app's back chevron in the top-left. Verifies the action changed the screen.
Explore an app's screens breadth-first and return a navigation map showing screens, controls, and transitions.
Find text on the screen by OCR and return its bounding box. Useful for locating controls before tapping.
Go to the iPhone Home Screen.
Open an app by name using Home > Spotlight > type > launch. Returns a report and screenshot.
Press a single named key on the iPhone: return, delete, escape, tab, space, or an arrow key (up/down/left/right).
No output schemas documented. LLMs cannot infer return types, field names, or structure. Downstream tool chaining is impossible without trial-and-error.
Parameter descriptions lack constraints. 'X coordinate in device points' does not specify valid range (0 to device_w). LLMs cannot validate inputs and may pass out-of-bounds values.
No error handling guidance. Tools raise MirroringPaused, CoordinatesOutOfRange, AccessibilityDenied but descriptions do not explain recovery steps or when to retry.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | C | 61 | 2026-07-28+ | v2 |
Press the Connect button on a paused mirroring session. Use when the iPhone was picked up and mirroring paused.
Capture the mirrored iPhone screen. Returns the image plus the device coordinate space to use for tap() and swipe(). Call this before every interaction.
Scroll the content area in a direction by roughly a fraction of the screen. Vertical scrolling uses wheel events; horizontal uses swipe gestures.
Open Spotlight search on the iPhone.
Start recording the iPhone screen to a file. Returns the path where the recording will be saved.
Stop recording the iPhone screen and return the path to the saved video file.
Swipe/drag on the iPhone screen from one device point to another. Use for scrolling, dismissing, and edge gestures. A longer duration_ms produces a slower drag; a short one flicks with momentum.
Tap the iPhone screen at a device point (see screenshot() for the coordinate space). Origin is the top-left of the phone screen.
Type text into whatever field is focused on the iPhone. Focus a text field with tap() first. Handles unicode and emoji.
Wait for the screen to stop changing, then return a screenshot. Use after any action that changes the screen.
Destructive operations (start_recording, stop_recording, home, app_switcher) lack confirmation or dry-run patterns. No idempotency guarantees documented.
explore_app has 4 parameters with complex semantics (max_screens, max_actions, max_depth) but no guidance on when to use vs. simpler tools or how to interpret results.