← All transcripts

Big AI wants you broke... here are some free alternatives Transcript, AI Summary & Key Points

Fireship · 8 days ago · Science & Technology · 05:26 · EN

Watch on YouTube

AI Summary

Five free and open-source tools can reduce AI costs and support a self-hosted developer stack: Ollama runs language models locally with private prompts and zero inference cost; 9router provides one local, OpenAI-compatible endpoint with fallback tiers across model providers; Headroom compresses tool outputs and logs before they become billable input tokens; Diffy builds visual AI workflows exposed through an API; and OpenHands runs autonomous coding agents on a virtual private server. Hostinger provides VPS hosting with a Docker catalog for deploying these tools.

Key Points

  • Ollama — Ollama provides a command-line interface and API for downloading and running language models locally. Prompts remain private, inference costs are zero, and small models run on almost any hardware, while frontier models require much more compute.
  • 9router — 9router places a local, OpenAI-compatible proxy between AI tools and dozens of model providers, replacing multiple API keys with one endpoint. Its fallback tiers can prioritize an existing subscription, then cheaper paid models, then free providers such as Chinese models and Vertex trial credits.
  • 9router — 9router can automatically move requests to the next fallback tier after a provider limit is reached, track usage, and compress tool output to reduce token consumption.
  • Headroom — Headroom compresses tool outputs, log files, and other unnecessary context before sending it to a model as billable input tokens. Its reversible compression is cached locally so the model can retrieve the original content when needed.
  • Hostinger — Hostinger offers virtual private server hosting and a built-in Docker catalog that can deploy the open-source projects with a single click, including multiple tools on the same VPS.
  • Diffy — Diffy is a visual builder for creating AI workflows by placing nodes on a canvas. A workflow can retrieve compatible records from a database, use a large language model to explain matches, and expose the complete workflow as an API.
  • OpenHands — OpenHands is an open-source autonomous coding agent that can work on GitHub issues. It provides a command center for self-hosting multiple always-on agents and can use OpenAI models, Anthropic models, or local language models installed with Ollama.
  • Q2 2026 — Building applications manually became outdated after the release of OpenHands.

Tools & resources

6 items

9No. 3536
AIAINotes.us AI product

9router

In the AINotes directory

9router is a local gateway between AI applications and model providers. It exposes one OpenAI-compatible endpoint, supports provider fallback tiers, tracks usage, and compresses tool outputs.

Mentioned in
1 video
Kind
AI
DNo. 3537
AIAINotes.us AI product

Diffy

In the AINotes directory

Diffy is an AI workflow tool with a visual canvas for building workflows that retrieve compatible database records, generate explanations for the matches, and expose the resulting workflow through an API.

Mentioned in
1 video
Kind
AI
HNo. 1209
AIAINotes.us AI product

Headroom

Open source · michellzappa/headroom

Headroom is a local-first macOS menu-bar app for monitoring AI coding quotas and software delivery status, with optional iPhone, iPad, Apple Watch, and ESP32 desk-display clients. A Python host running on the Mac reads the authentication data and command-line tools already configured for services such as Claude, Codex, Cursor, GitHub, and Vercel, then serves a single local JSON feed; credentials remain on the machine and no Headroom cloud account is required. Its interfaces show provider quota meters, usage rings, burn rate and spend, failed Actions, deployments, monitors, and other attention items, and the iPhone client can approve, deny, or reply to Claude and Codex requests without starting work. The Mac host uses port 8737, requires macOS 14+ and Python 3.9+, and the optional desk display uses a Waveshare ESP32-S3-Touch-AMOLED-1.8 board.

Mentioned in
2 videos
Kind
AI
HNo. 1591
AIAINotes.us Tool

Hostinger

hostinger.com/pl?session=1026cb21208480a

Hostinger is a web hosting provider operated by Hostinger International Ltd that offers shared hosting, VPS and cloud hosting, domain registration, and website builder tools. It markets services globally through localized sites and partner/affiliate links.

Mentioned in
2 videos
Kind
Other
ONo. 0875
AIAINotes.us AI product

Ollama

Open source · ollama

Ollama is a software platform for running and serving open models, including as a local model runtime for tasks such as resume evaluation, tagging, and summarization. Its website describes integrations with coding agents and other workflows, allowing users to launch tools such as Claude Code, Codex, OpenCode, and VS Code while switching models without changing the workflow. Local runs remain on the user's machine, while Ollama also offers hosted cloud models. The service states that prompts are not tracked or used for training by providers, and that its open-source software and open model support are intended to keep data private while automating work.

Mentioned in
6 videos
Kind
AI
ONo. 3538
AIAINotes.us AI product

OpenHands

In the AINotes directory

OpenHands is a self-hosted platform for running autonomous coding agents that work on GitHub issues. It can use either remote model providers or language models installed locally.

Mentioned in
1 video
Kind
AI

AI in practice

Used for

Agents

  • OpenHands — Work through GitHub issues and handle software-building and fixing work autonomously. 2 held 00:25

Business ideas

Build an application that accepts user or item profiles, retrieves compatible matches from a database, uses a large language model to explain the matches, and exposes the workflow through an API for a front-end application.

Solves
Helps users discover compatible matches and understand why those matches are suitable.
  • Horse Tinder: uses horse profiles, database retrieval, and a language model to explain matches. Thunder and Butternuts are presented as a 94% match because both enjoy trail rides and biting children.
🔒  Build steps and tools for 1 idea. Unlock

Links mentioned

🔒 Full analysis locked

Unlock more videos and the full analysis

A credit unlocks one video's full analysis for good — the build steps, the tools and how each was used, the methods behind every use case. Pro opens the whole library instead, and raises how many videos you can analyse a day.

Unlock full analysis — free

Transcript

Searchable transcript of Big AI wants you broke... here are some free alternatives — Fireship (05:26). Search for a phrase, then click its timestamp to jump straight to that moment in the video.

Captions sourced from the original video on YouTube, published by Fireship. The video, its captions and all related intellectual property remain the property of their respective owners; AINotes claims no ownership. Provided for research, accessibility and search — see the Transcript Notice and Copyright Policy.

00:00 But recently, I did some math and it made me realize how broken the world is. Accursor, $20. Claude Max, $100. GPT Pro, another hundred. Gemini Ultra, another hundred. Not to mention 11 Labs, Deepseek, and all the API keys I signed up for 2 years ago and forgot about. My AI addiction got so expensive that I had to quit alcohol and Zen. And I'm not the only one because alcohol sales in the United States are currently sitting at historic lows.

00:24 And big AI is the one to blame for this. But that was my wakeup call. And since then, I've canceled all these subscriptions and now self-host the ultimate AI stack for developers that's not only cheaper, but far more productive. In today's video, we'll look at a bunch of free and open- source projects you can run on your own server. We'll make them work together while still having the option to tap into the intelligence of big models like Claude and GPT Soul.

00:46 It is September 7th, 2026, and you're watching the code report. The first tool we need to talk about is Olama because every AI stack first needs a model. For most people, this means sending your proprietary code to a trillion dollar corporation and trusting them to keep it totally safe. Or you can use Olama and do everything locally. I've talked about this tool many other times on the channel.

01:05 And essentially, it's like Docker for large language models. It gives you a simple command line interface and API for downloading and running models on your own machine. This is great if you want to try out the latest Chinese models or any other OpenWeight models. And what's even better is that all your prompts stay private and the inference cost is zero, which means the model continues to work even after your credit card is declined.

01:27 The big problem though is that you probably don't own the hardware to run anything close to state-of-the-art. The small models will run almost anywhere, but running a Frontierized model would require a small data center, and that's a big problem if you're a Vibe engineer who needs to write top tier slot. Luckily, there's a self-hostable solution to this called Nine Routouter, which is an AI tool that sits between your AI tools and dozens of different model providers through one local endpoint.

01:49 Instead of juggling nine different API keys, Nouter provides one door with an OpenAI compatible proxy that allows you to point everything through local host. But the thing that's really cool about Nine Router is fallback tiers. On tier one, you might have an existing subscription like Claude Max that you already pay for. Then on tier two, you might have a cheap paper token OpenAI model as a backup.

02:11 Then tier three has all of your free providers like Chinese models, Vertex trial credits, and so on. That means if you max out Cloud Max, it'll automatically roll over to the next tier without you having to do anything. But in addition to that, Nouter also tracks usage and will compress your tool output to reduce token consumption, which will ultimately save you a bunch of money.

02:30 But if you're still eating billions of tokens per day, then you need to know about headroom, which is a context compression layer for AI agents. You ask AI to center a div. And to do that, it reads 50,000 lines of your package lock JSON file. Then it evaporates an Olympic size swimming pool worth of water just to realize it needs to install Tailwind CSS.

02:48 Headroom sits between your application and the model provider and compresses everything from tool outputs to log files and any other useless chunks before it actually goes to the model, which would be billable input tokens. And one clever design feature of this tool is that it's reversible. The compressed content that ships to the model is cached on your local machine, which means if the model ever needs it, it can always retrieve it.

03:09 This sounds awesome, but at this point, you might be wondering, where do I deploy all this stuff? Well, the answer, of course, is Hostinger, the sponsor of today's video. Not only is it one of the most affordable places to host your own virtual private server, but they also have an entire Docker catalog built into the panel, which means every single open-source project I talk about in this video can be hosted there with a single click.

03:30 In fact, you could have all these tools running and working together on the same VPS. Head over to hostinger.com/fireship and use my coupon code to save a bunch of money spinning up your own VPS. Once you have that done, the next tool you'll want to install there is Diffy. Everything we've talked about so far is infrastructure, but now it's time to build an actual app that'll make us rich.

03:49 Instead of trying to engineer everything through prompts, Diffy is a visual builder that allows us to drag nodes on a canvas. This has been a gamecher for Horse Tinder and its AI matchmaking feature. The app will send Diffy each horse's profile information. Then a visual workflow retrieves compatible horses from the database and uses a large language model to explain each match.

04:08 like Thunder and Butternuts are a 94% match because they both enjoy trail rides and biting children. Then the entire workflow is exposed as an API, so the front-end application can just call it whenever a horse swipes right. Amazing. But building apps as a human became outdated in Q2 2026 after the release of Open Hands, which is an open- source tool that allows you to fire yourself.

04:29 This tool is a top performing autonomous coding agent on swbench verified which is the benchmark where models fix real GitHub issues instead of trying to build and fix things. It just open up GitHub issues and let open hands do all the work. Essentially, it gives you a command center where you can self-host an army of AI agents that are always on and working in the background.

04:48 And because it's running on your own virtual private server, you have the option to run it with OpenAI or anthropic models or use the local LLMs that you installed earlier with Olama. And now at this point, we have our own private AI stack that could build any type of software you can imagine. But this is just the tip of the iceberg. And there's tons of other open- source applications in Hostinger's Docker catalog that you can install with zero hassle.

05:10 Check out the link below and use coupon code fire to get your own virtual private server on Hostinger up and running right now. This has been the code report. Thanks for watching and I will see you in the next one.