AI product
Nebius Token Factory is a managed inference and AI platform from Nebius for running open large language and image models in production. It provides premium open-source models, API integration, and infrastructure that scales automatically.
The platform connects inference with production-data analysis, post-training, model optimization, and deployment. Its serving approach includes hardware-aware inference such as NVFP4, serving-engine selection, cache-aware routing, speculative decoding with custom draft models, KV-cache offloading, disaggregated prefill and decode, and quantization trade-offs, while handling infrastructure and serving optimizations.
1 use taken from transcripts — each links to the moment in the video.
A managed inference and AI platform for running open models in production. It connects inference, production-data analysis, post-training, model optimization, and deployment, while handling infrastructure and serving optimizations.
1 in the library.