Low-rank finetuning for LLMs: A fairness perspective

Saswat Das, Marco Romanelli, Cuong Tran +3

Low-rank approximation techniques have become the de facto standard for fine-tuning Large Language Models (LLMs) due to their reduced computational and memory requirements. This pa…