Local execution runtime for large Qwen models on iPhones
A Swift and Metal runtime that runs 35B and 80B Qwen mixture-of-experts models on Apple devices by streaming routed experts from storage.
online BOTH AI Agents & Automation
From ManuAGI - AutoGPT Tutorials — Top Open-Source GitHub Projects : AutoGPT, Capptivo, anydoc, Swiftlet, waku-agent & morphicons #282 at 11:02
Problem: Large models normally exceed the available memory of smaller Apple devices.
For: Developers and researchers who want to run large language models locally on Apple devices, including iPhones.
Products from this video
Agent Substrate anydoc AutoGPT Backchannel Can I Vibecode It? Capptivo Comp AI CRM DeepTutor Desktop Commander MCP Hallmark MAGI-2 Preview MiroFish morphicons OfficeCLI Semantica SimpleEnglish Swiftlet TencentDB Agent Memory vPhone Workstation Waku Agent
Examples
- The 35B model is stated to fit on an iPhone.
Other takes on AI agent platforms and compute access
- Autonomous AI agents that perform administrative labor for underserved small businesses, starting with dental practices
- A personal, open-source AI agent that can be operated through messaging channels such as WhatsApp and Discord
- Enterprise AI concierge for customer, sales, and operational workflows
- AI appointment-scheduling assistant for healthcare providers
- Production-ready inference hosting for open AI models
- A cloud-hosted AI co-founder club that gives each member a personal, containerized AI agent
All AI agent platforms and compute access ideas →