QLoRA

  1. Unsloth: 2x Faster LLM Fine-Tuning with Reduced Memory

    Fine-tuning large language models on consumer hardware has been a game of memory optimization Tetris. Every byte of GPU memory is precious — model...

    Open Source

  2. LlamaFactory: Open-Source LLM Fine-Tuning Framework

    Fine-tuning large language models was once a complex, resource-intensive process reserved for organizations with large GPU clusters. LlamaFactory has...

    Open Source

  3. bitsandbytes: Essential k-bit Quantization Library for LLM Training and Inference

    Large language models have grown far beyond the memory capacity of consumer hardware. A 70-billion-parameter model requires 140 gigabytes of GPU...

    AI