AI product Open source

Unsloth

Unsloth is an open-source local desktop and web tool for running, training, fine-tuning, and deploying language, diffusion, embedding, audio, and vision models. It supports Windows, macOS, Linux, WSL, multi-GPU setups, NVIDIA, AMD, and Intel GPUs, CPUs, and the Vulkan backend.

View repository Visit site Mentioned in 1 video ↓

Overview

The project is distributed as Unsloth Desktop, Unsloth Studio, and Unsloth Core. It can run local models, provide an OpenAI-compatible API, connect models to agents and MCP tools, perform search and RAG, and offer remote or LAN access. Its training functions cover reinforcement learning, LoRA, QLoRA, full fine-tuning, pretraining, GRPO, DPO, and FP8, with export formats including GGUF, NVFP4, and FP8. The repository claims that its fine-tuning workflows use two times less training time and 70% less VRAM.

What Unsloth is used for

1 use taken from transcripts — each links to the moment in the video.

  • An open-source tool for running, training, fine-tuning, and deploying AI models locally. It reduces memory use and training time and supports language, diffusion, embedding, audio, and vision models.

Videos mentioning Unsloth

1 in the library.