AI Tools / AI products & services
Phone Harness is an open-source harness that lets AI agents such as Claude Code, Codex, or other LLMs control a real iPhone or Android phone without a jailbreak, injected app, Xcode, WebDriverAgent, or on-device installation. It exposes a shared set of helpers for opening apps, reading screen content, tapping, scrolling, typing, and verifying actions.
On iPhone, it uses the macOS iPhone Mirroring window as the transport: screenshots are captured from the window, Apple's Vision framework performs OCR and returns text with tap-ready coordinates, and HID-level CGEvents provide taps, long presses, drags, flicks, scrolling, typing, and shortcuts. On Android, it uses adb over USB or Wi-Fi, combining screenshots with the phone's uiautomator accessibility tree for text and element boxes. Each invocation is self-contained rather than relying on a daemon; persistent configuration and paired Android devices are stored locally. The repository documents limits including one iPhone per session, no multi-touch, unavailable camera or Face ID flows, black DRM video, and ASCII-only Android text input.
Automates an iPhone through macOS iPhone Mirroring by taking screenshots, using Apple's vision OCR to locate text, and sending synthetic clicks. It requires no jailbreak or injected app.