BaRA: Bayesian Adaptive Rank Allocation for Parameter-Efficient Fine-Tuning

Zhibin Duan, Yuhong Wang, Jiahong Fu +3

While Low-rank adaptation (LoRA) enables highly efficient fine-tuning by constraining task-specific updates to fixed low-rank subspaces, this rigid design limits representational f…