Unsloth

Summary

Integrates with Unsloth, a library that makes LLM fine-tuning 2x faster with 80% less memory usage. Provides optimization for fine-tuning Llama, Mistral, Phi, Gemma, and other models through custom CUDA kernels and dynamic 4-bit quantization.

Links

GitHub