3 citations · 3 across the 3 of their papers we have counts for
3 papers
cs.CL2024
ResLoRA: Identity Residual Mapping in Low-Rank Adaption
Shuhua Shi, Shaohan Huang, Minghui Song +7
As one of the most popular parameter-efficient fine-tuning (PEFT) methods, low-rank adaptation (LoRA) is commonly applied to fine-tune large language models (LLMs). However, updati…
cs.CL2024★ 3 cited
Improving Domain Adaptation through Extended-Text Reading Comprehension
Ting Jiang, Shaohan Huang, Shengyue Luo +8
To enhance the domain-specific capabilities of large language models, continued pre-training on a domain-specific corpus is a prevalent method. Recent work demonstrates that adapti…
cs.CL2023
Democratizing Reasoning Ability: Tailored Learning from Large Language Model
Zhaoyang Wang, Shaohan Huang, Yuxuan Liu +8
Large language models (LLMs) exhibit impressive emergent abilities in natural language processing, but their democratization is hindered due to huge computation requirements and cl…