2 papers
cs.CV2025
Sparse-to-Dense: A Free Lunch for Lossless Acceleration of Video Understanding in LLMs
Xuan Zhang, Cunxiao Du, Sicheng Yu +4
Due to the auto-regressive nature of current video large language models (Video-LLMs), the inference latency increases as the input sequence length grows, posing challenges for the…
cs.CL2025
Tutorial Proposal: Speculative Decoding for Efficient LLM Inference
Heming Xia, Cunxiao Du, Yongqi Li +2
This tutorial presents a comprehensive introduction to Speculative Decoding (SD), an advanced technique for LLM inference acceleration that has garnered significant research intere…