QLoRA

Low-rank adaptation freezes the original weights and trains a pair of small matrices alongside them. QLoRA adds four-bit quantisation of the frozen base, cutting memory again.

The practical effect is that fine-tuning a substantial open model becomes a consumer-hardware task rather than a cluster task, and the resulting adapter is small enough to ship as a file.