5 citations · 5 across the 9 of their papers we have counts for
Showing cs.LGShow all
2 papers · 1 filter
cs.LG2026
STS: Efficient Sparse Attention with Speculative Token Sparsity
Jiangnan Yu, Ceyu Xu, Yongji Wu +1
The quadratic complexity of attention imposes severe memory and computational bottlenecks on Large Language Model (LLM) inference. This challenge is particularly acute for emerging…
cs.LG2024
VcLLM: Video Codecs are Secretly Tensor Codecs
Ceyu Xu, Yongji Wu, Xinyu Yang +4
As the parameter size of large language models (LLMs) continues to expand, the need for a large memory footprint and high communication bandwidth have become significant bottleneck…