Nebius

Nebius Token Factory is a managed inference and AI platform from Nebius for running open large language and image models in production. It provides premium open-source models, API integration, and infrastructure that scales automatically. The platform connects inference with production-data analysis, post-training, model optimization, and deployment. Its serving approach includes hardware-aware inference such as NVFP4, serving-engine selection, cache-aware routing, speculative decoding with custom draft models, KV-cache offloading, disaggregated prefill and decode, and quantization trade-offs, while handling infrastructure and serving optimizations.

Nebius Token Factory documentation is a technical documentation resource for using Nebius Token Factory, maintained on Nebius's documentation site. Its quickstart shows how to authenticate with an API key and send inference requests from Python, JavaScript, or cURL through an OpenAI-compatible API. The documentation covers experimentation in a model playground, inference for prompts, chats, and images, third-party integrations, fine-tuning with datasets, and API usage; it also links to Nebius's cookbook of reusable examples and demo applications.

Baseten is an inference platform and company that provides tools to deploy, serve, and scale open-source and custom AI models in production. It offers managed infrastructure and tooling for model hosting, APIs, and inference at scale.

Netic is an AI operations platform for essential-service companies that mediates customer interactions and deploys AI agents across voice, text, and websites. It applies operational rules, coordinates labor, and supports inbound, outbound, and analytical workflows.

Groq (Groq Inc.) is a U.S.-based company that designs AI accelerator hardware and provides a cloud-based inference platform. The company builds a tensor-streaming architecture and ships hardware and software for high-throughput, low-latency machine learning inference. Its public site describes a "neocloud" offering for inference and infrastructure.