1 citations · 1 across the 3 of their papers we have counts for
Showing cs.CLShow all
2 papers · 1 filter
cs.CL2025
DropLoRA: Sparse Low-Rank Adaptation for Parameter-Efficient Fine-Tuning
Haojie Zhang
LoRA-based large model parameter-efficient fine-tuning (PEFT) methods use low-rank de- composition to approximate updates to model parameters. However, compared to full- parameter…
cs.CL2022★ 1 cited
Better Pre-Training by Reducing Representation Confusion
Haojie Zhang, Mingfei Liang, Ruobing Xie +3
In this work, we revisit the Transformer-based pre-trained language models and identify two different types of information confusion in position encoding and model representations,…