AI product Open source
Phone Harness is an open-source harness that lets AI agents such as Claude Code, Codex, or other LLMs control a real iPhone or Android phone without a jailbreak, injected app, Xcode, WebDriverAgent, or on-device installation. It exposes helpers for opening apps, reading screen content, tapping, scrolling, typing, and verifying actions. On iPhone, it uses the macOS iPhone Mirroring window as the transport: screenshots are captured from the window, Apple's Vision framework performs OCR and returns tap-ready coordinates, and HID-level CGEvents provide taps, long presses, drags, flicks, scrolling, Unicode typing, and shortcuts. On Android, it uses ADB over USB or Wi-Fi, combining screenshots with the phone's accessibility tree for text and element bounding boxes. Actions can be verified by capturing the screen again, with the screenshot serving as the ground truth rather than relying on a DOM. Each invocation is self-contained rather than relying on a daemon.
2 uses taken from transcripts — each links to the moment in the video.
A tool for letting an agent drive an iPhone without a jailbreak or WebDriver agent. Screen capture and Apple's Vision OCR turn visible text into tap-ready coordinates, and simulated events perform taps with screenshot-based verification.
Automates an iPhone through macOS iPhone Mirroring by taking screenshots, using Apple's vision OCR to locate text, and sending synthetic clicks. It requires no jailbreak or injected app.
2 in the library.