7 citations · 16 across the 6 of their papers we have counts for
Showing 2024Show all
2 papers · 1 filter
cs.CL2024★ 2 cited
Ouroboros: Generating Longer Drafts Phrase by Phrase for Faster Speculative Decoding
Weilin Zhao, Yuxiang Huang, Xu Han +7
Speculative decoding is a widely used method that accelerates the generation process of large language models (LLMs) with no compromise in model performance. It achieves this goal…
cs.LG2024★ 3 cited
LoRA-drop: Efficient LoRA Parameter Pruning based on Output Evaluation
Hongyun Zhou, Xiangyu Lu, Wang Xu +3
Low-Rank Adaptation (LoRA) is currently the most commonly used Parameter-efficient fine-tuning (PEFT) method, it introduces auxiliary parameters for each layer to fine-tune the pre…