Local execution runtime for large Qwen models on iPhones
A Swift and Metal runtime that runs 35B and 80B Qwen mixture-of-experts models on Apple devices by streaming routed experts from storage.
online BOTH AI Agents & Automation
From ManuAGI - AutoGPT Tutorials — Top Open-Source GitHub Projects : AutoGPT, Capptivo, anydoc, Swiftlet, waku-agent & morphicons #282 at 11:02
Problem: Large models normally exceed the available memory of smaller Apple devices.
For: Developers and researchers who want to run large language models locally on Apple devices, including iPhones.
Examples
- The 35B model is stated to fit on an iPhone.
Soon you can unlock the full business plan.
Behind this: 8 build steps · 4 tools and how each is used · how to validate demand · 1 more real example · 3 things the video never answers.
Other takes on AI agent platforms and compute access
- Autonomous AI agents that perform administrative labor for underserved small businesses, starting with dental practices
- A personal, open-source AI agent that can be operated through messaging channels such as WhatsApp and Discord
- Enterprise AI concierge for customer, sales, and operational workflows
- AI appointment-scheduling assistant for healthcare providers
- Production-ready inference hosting for open AI models
- A cloud-hosted AI co-founder club that gives each member a personal, containerized AI agent