AI Tools / AI products & services

Phone Harness

Phone Harness is an open-source harness that lets AI agents such as Claude Code, Codex, or other LLMs control a real iPhone or Android phone without a jailbreak, injected app, Xcode, WebDriverAgent, or on-device installation. It exposes a shared set of helpers for opening apps, reading screen content, tapping, scrolling, typing, and verifying actions.

On iPhone, it uses the macOS iPhone Mirroring window as the transport: screenshots are captured from the window, Apple's Vision framework performs OCR and returns text with tap-ready coordinates, and HID-level CGEvents provide taps, long presses, drags, flicks, scrolling, typing, and shortcuts. On Android, it uses adb over USB or Wi-Fi, combining screenshots with the phone's uiautomator accessibility tree for text and element boxes. Each invocation is self-contained rather than relying on a daemon; persistent configuration and paired Android devices are stored locally. The repository documents limits including one iPhone per session, no multi-touch, unavailable camera or Face ID flows, black DRM video, and ASCII-only Android text input.

AI product
View repository
Mentioned in 1 video
Kind AI product or service

What people use it for

Where it was mentioned