03 · How Models Learn
LoRA
Low-Rank Adaptation
The most popular PEFT method. Freeze the original model, train tiny “adapter” matrices bolted on. Cuts fine-tuning cost dramatically and lets people customize big models on modest hardware.
Concrete example
How hobbyists fine-tune a large image or language model on a single rented GPU.