TASO: Task-Aligned Sparse Optimization for Parameter-Efficient Model Adaptation

Daiye Miao, Yufang Liu, Jie Wang +6

LoRA has become one of the most widely used parameter-efficient fine-tuning methods due to its simplicity and effectiveness. However, numerous studies have shown that LoRA often in…