Soup

What people use it for

An open-source Python CLI that simplifies LLM fine-tuning and post-training through YAML configuration and a single training command. It supports LoRA, QLoRA, supervised fine-tuning, preference optimization, and optional layer streaming to reduce VRAM use.

ManuAGI - AutoGPT Tutorials
Fine-tunes LLMs locally from one YAML file and one command, handling batch size, GPU detection, quantization, and QLoRA. It also mitigates reward hacking during GRPO runs.

Github Awesome