open-appleremote

ESP32 iPhone Agent is an open-source AI automation tool that lets a vision model control a real iPhone without installing an app, using a computer, AirPlay mirroring, and an ESP32-S3 board acting as a USB mouse and keyboard. UxPlay receives the AirPlay stream, a GStreamer pipeline converts it into JPEG frames, and the computer sends relative pointer, typing, scrolling, and key commands to the board over Wi-Fi. A planner model creates a short plan from the task and current screen, while an actor model examines each subsequent screenshot and selects actions such as tapping, swiping, drawing, typing, pressing keys, going home, or finishing. The server tracks and recalibrates the relative pointer, checks whether the screen changed after each action, and can retry or re-plan after missed actions, repeated actions, dropped links, or invalid model responses. The project provides a Python/FastAPI server and browser-based interface with live phone control, logs, screenshots with action overlays, manual controls, calibration, and an emergency stop. It runs on macOS or Linux with an OpenAI-compatible vision model, either remote or local; the phone requires AssistiveTouch but no Mac, developer account, jailbreak, or installed app. The repository is licensed under MIT.

OpenLogi is a native, local-first desktop application and CLI for configuring Logitech mice, keyboards, lights, and UVC webcams without Logitech Options+, an account, or telemetry. Written in Rust with GPUI, it communicates with supported devices through HID++, UVC, Logi Bolt and Unifying receivers, Bluetooth, or wired connections. It provides button and F-key remapping, DPI presets, SmartShift controls, gesture bindings, device-specific settings, per-application profile overlays, webcam image controls, and plain-text TOML configuration; the GUI and CLI run on macOS, Linux, and Windows, although some profile and platform actions have narrower support. The repository states that the project is under active development and not yet stable.

Escrcpy is an open-source graphical interface for displaying and controlling Android devices through the scrcpy engine. It provides an embedded mirror with screen-fitting and orientation handling, configurable mappings for touch, joystick, swipe, scrolling, and automation, simultaneous control of multiple devices with broadcast input, batch screenshots and APK installation, and a draggable control bar for device operations. It also supports wireless ADB connections with LAN discovery and Gnirehtet reverse tethering, visual step-by-step automation with screen-image recognition, global shortcuts, and an MCP-based AI assistant with multi-model chat. Released packages are available for manual installation, with macOS installation through Homebrew; advanced features from the private EscrcpyX extension are paid, and the project states that updates are irregular.

OpenWhispr is an open-source, cross-platform desktop voice-to-text application for macOS, Windows, and Linux. A global hotkey captures speech and inserts the resulting text at the cursor in another application; dictation can use local Whisper or NVIDIA Parakeet speech-to-text engines, where audio remains on the device, or cloud providers through user-supplied keys. It also supports dictation translation, AI-agent commands, meeting transcription with speaker diarization and voice fingerprinting, audio and video transcription, and searchable notes with semantic search and optional cloud sync. The application is built with Electron, React, TypeScript, SQLite, whisper.cpp, and sherpa-onnx, and provides an API and MCP server for programmatic access to notes and transcriptions. The repository describes it as having no data collection or telemetry and distributes installers for the three supported desktop platforms. It is licensed under the MIT license.

BetterWispr is a free, open-source, local-first voice-dictation app for macOS. It uses Apple on-device speech recognition, NVIDIA Parakeet, or Whisper to transcribe speech locally and paste the result into the active application; built-in models work offline after download. It supports hold-to-talk or toggle shortcuts, vocabulary and phrase replacements, voice commands, correction learning, and locally stored transcript history. Its meeting mode provides live transcripts, titles, summaries, and action items using Apple Intelligence or a local Ollama model. Optional Sarvam AI, Smallest AI, and OpenAI-compatible endpoints can be added, in which case audio is sent to the selected endpoint rather than handled entirely on-device. The project requires macOS 14 or later, recommends Apple Silicon, and is distributed under the Apache-2.0 license.