8 citations · 15 across the 8 of their papers we have counts for
Showing 2024 · cs.LGShow all
2 papers · 2 filters
cs.LG2024★ 8 cited
LoRA Dropout as a Sparsity Regularizer for Overfitting Control
Yang Lin, Xinyu Ma, Xu Chu +4
Parameter-efficient fine-tuning methods, represented by LoRA, play an essential role in adapting large-scale pre-trained models to downstream tasks. However, fine-tuning LoRA-serie…
cs.LG2024
Parameter Efficient Quasi-Orthogonal Fine-Tuning via Givens Rotation
Xinyu Ma, Xu Chu, Zhibang Yang +3
With the increasingly powerful performances and enormous scales of pretrained models, promoting parameter efficiency in fine-tuning has become a crucial need for effective and effi…