Unsloth: 2x Faster LLM Fine-Tuning with Reduced Memory
Fine-tuning large language models on consumer hardware has been a game of memory optimization Tetris. Every byte of GPU memory is precious — …
Tags
QLoRA
LlamaFactory: Open-Source LLM Fine-Tuning Framework
Fine-tuning large language models was once a complex, resource-intensive process reserved for organizations with large GPU clusters. LlamaFactory …
bitsandbytes: Essential k-bit Quantization Library for LLM Training and Inference
Large language models have grown far beyond the memory capacity of consumer hardware. A 70-billion-parameter model requires 140 gigabytes of GPU …