2 papers
cs.AR2026
RedFuser: An Automatic Operator Fusion Framework for Cascaded Reductions on AI Accelerators
Xinsheng Tang, Yangcheng Li, Nan Wang +5
Operator fusion, as a key performance optimization technique in the deployment of AI models, significantly improves execution efficiency and has been widely adopted in modern AI co…
cs.CL2025
AATS: Retrieval-Based KV Cache Reduction via Windowed Rotary Position Embedding and Query-Aware Vector Quantization
Junhui He, Junna Xing, Nan Wang +6
Long context large language models (LLMs) pose significant challenges for efficient serving due to the large memory footprint and high access overhead of KV cache. Retrieval-based…