Featherless AI

FriendliAI is an inference cloud and API for running frontier open-weight and custom AI models in production, with support for long-context inference, real-time streaming, tool calling, and agent workloads. Its stack combines custom GPU kernels, continuous batching, parallel inference, prefix caching with cache-aware routing, and a GPU-, CPU-, and NVMe-based KV-cache hierarchy for repetitive or long agent inputs. It also uses hybrid speculative decoding that adapts to live traffic, alongside multi-cloud scaling and autoscaling. The service provides model APIs and one-click deployment for models from Hugging Face, as well as deployment support for proprietary or fine-tuned models. FriendliAI advertises 99.99% uptime SLAs and reports performance claims including up to 7x faster output token speed and lower inference costs.

Together AI (branded Together) operates an "AI native cloud": a platform for deploying, running, and scaling AI models and applications. The service provides infrastructure and tooling for developing and serving machine learning and large language models.

A serverless AI inference platform from Cloudflare that runs machine-learning models on Cloudflare's network and exposes them through the Workers platform. It supports tasks such as text generation, image generation, speech recognition, and text embeddings, making it usable for applications including semantic search.

Fireworks is an AI platform that provides training and inference tools to transform open models into domain-specific or specialized intelligence. The service offers capabilities for model training, fine-tuning and serving to support customized AI deployments.

Fireworks AI is a training and inference platform for transforming open models into specialized, deployable AI systems. Its training offerings range from guided runs, where the platform helps define the task and plan, through configuration-led managed training, to user-written training logic with custom losses, trainers, and reinforcement-learning loops; trained checkpoints can be deployed to production. Its inference service supports open models and customer-trained versions through serverless, dedicated on-demand, and reserved deployments, with an optimized inference engine and OpenAI- and Anthropic-compatible interfaces. Fireworks also provides a model library for running open-source models and supports the continuous train-and-serve workflow described by the videos, including monitoring, hot-loading new weights without downtime, and matching training and serving numerics.