6 citations · 9 across the 2 of their papers we have counts for
2 papers
cs.CL2024★ 6 cited
MoRA: High-Rank Updating for Parameter-Efficient Fine-Tuning
Ting Jiang, Shaohan Huang, Shengyue Luo +8
Low-rank adaptation is a popular parameter-efficient fine-tuning method for large language models. In this paper, we analyze the impact of low-rank updating, as implemented in LoRA…
cs.CL2024★ 3 cited
Improving Domain Adaptation through Extended-Text Reading Comprehension
Ting Jiang, Shaohan Huang, Shengyue Luo +8
To enhance the domain-specific capabilities of large language models, continued pre-training on a domain-specific corpus is a prevalent method. Recent work demonstrates that adapti…