activity
20232026
most citedE-Sparse: Boosting the Large Language Model Inference through Entropy-based N:M Sparsity

4 citations · 5 across the 7 of their papers we have counts for

collaborators
Showing 2024Show all

2 papers · 1 filter

cs.CL2024★ 1 cited

PEARL: Parallel Speculative Decoding with Adaptive Draft Length

Tianyu Liu, Yun Li, Qitan Lv +4

Speculative decoding (SD), where an extra draft model is employed to provide multiple draft tokens first, and then the original target model verifies these tokens in parallel, has…

cs.AI2024

EasyQuant: An Efficient Data-free Quantization Algorithm for LLMs

Hanlin Tang, Yifu Sun, Decheng Wu +3

Large language models (LLMs) have proven to be very superior to conventional methods in various tasks. However, their expensive computations and high memory requirements are prohib…