SSMLoRA: Enhancing Low-Rank Adaptation with State Space Model

Jiayang Yu, Yihang Zhang, Bin Wang +3

Fine-tuning is a key approach for adapting language models to specific downstream tasks, but updating all model parameters becomes impractical as model sizes increase. Parameter-Ef…