activity
20222026
most citedSparse*BERT: Sparse Models Generalize To New tasks and Domains

4 citations · 6 across the 7 of their papers we have counts for

collaborators
Showing 2026Show all

2 papers · 1 filter

cs.LG2026

H-Spec: Parallel Speculative Decoding Without a Drafter-Side KV Cache

Weifan Jiang, Krishna Teja Chitty-Venkata, Megan Flynn +6

Speculative decoding losslessly accelerates large language model inference by having a lightweight draft model predict future tokens for verification by the target model. Recent bl…

cs.LG2026

An Interpretable Latency Model for Speculative Decoding in LLM Serving

Linghao Kong, Megan Flynn, Michael Peng +3

Speculative decoding (SD) accelerates large language model (LLM) inference by using a smaller draft model to propose multiple tokens that are verified by a larger target model in p…