BoostLoRA: Growing Effective Rank by Boosting Adapters

Raviteja Anantha, Nick Levato, Layne C. Price

Parameter-efficient fine-tuning (PEFT) methods face a tradeoff between adapter size and expressivity: ultra-low-parameter adapters are confined to fixed low-rank subspaces, capping…