1 citations · 1 across the 7 of their papers we have counts for
Showing 2024Show all
2 papers · 1 filter
cs.CL2024
Understanding Layer Significance in LLM Alignment
Guangyuan Shi, Zexin Lu, Xiaoyu Dong +4
Aligning large language models (LLMs) through supervised fine-tuning is essential for tailoring them to specific applications. Recent studies suggest that alignment primarily adjus…
cs.CL2024
Recurrent Drafter for Fast Speculative Decoding in Large Language Models
Yunfei Cheng, Aonan Zhang, Xuanyu Zhang +2
We present Recurrent Drafter (ReDrafter), an advanced speculative decoding approach that achieves state-of-the-art speedup for large language models (LLMs) inference. The performan…