3 papers
cs.CV2025
Can Visual Input Be Compressed? A Visual Token Compression Benchmark for Large Multimodal Models
Tianfan Peng, Yuntao Du, Pengzhou Ji +9
Large multimodal models (LMMs) often suffer from severe inference inefficiency due to the large number of visual tokens introduced by image encoders. While recent token compression…
cs.CL2025
Speculative Decoding and Beyond: An In-Depth Survey of Techniques
Yunhai Hu, Zining Liu, Zhenyuan Dong +3
Sequential dependencies present a fundamental bottleneck in deploying large-scale autoregressive models, particularly for real-time applications. While traditional optimization app…
cs.AR2025
HAAN: A Holistic Approach for Accelerating Normalization Operations in Large Language Models
Tianfan Peng, Jiajun Qin, Tianhua Xia +1
Large language models (LLMs) have revolutionized natural language processing (NLP) tasks by achieving state-of-the-art performance across a range of benchmarks. Central to the succ…