MiSS: Revisiting the Trade-off in LoRA with an Efficient Shard-Sharing Structure

Jiale Kang, Qingyu Yin

Low-Rank Adaptation (LoRA) is a widely adopted technique for parameter-efficient fine-tuning, but its slow convergence has spurred the development of numerous variants. Nevertheles…