Unsloth
#1Fine-tune LLMs up to 5x faster with 70% less VRAM usage
Unsloth is an open-source library that dramatically accelerates LLM fine-tuning by rewriting key CUDA kernels in Triton. It supports QLoRA and LoRA training for Llama, Mistral, Gemma, and other models with minimal code changes. Targeted at ML engineers and researchers who want to fine-tune large models on consumer or budget GPUs.