Expressive and Generalizable Low-rank Adaptation for Large Models via Slow Cascaded Learning

Siwei Li, Yifan Yang, Yifei Shen +4

Efficient fine-tuning plays a fundamental role in modern large models, with low-rank adaptation emerging as a particularly promising approach. However, the existing variants of LoR…