Beyond Rotations: AuroOFT for Expressive Quantized Orthogonal Fine-Tuning

Yue Han, Dianlin Wang

Quantized orthogonal fine-tuning (qoft) enables parameter-efficient adaptation of low-bit language models by learning structured activation rotations before frozen quantized weight…