Showing cs.LGShow all
3 papers · 1 filter
cs.LG2026
MXAttention: Data-Free Optimal Scaling and Pre-Normalization Quantization for MXFP4 Attention
Jianlin Yu, Jing Lin, Linghui Kong +13
The quadratic cost of attention is a major bottleneck in diffusion-based video generation models. MXFP4 attention provides a promising path toward efficient inference, but direct M…
cs.LG2025
MEPIC: Memory Efficient Position Independent Caching for LLM Serving
Qian Wang, Zahra Yousefijamarani, Morgan Lindsay Heisler +8
Modern LLM applications such as deep-research assistants, coding agents, and Retrieval-Augmented Generation (RAG) systems, repeatedly process long prompt histories containing share…
cs.LG2025
AnyExperts: On-Demand Expert Allocation for Multimodal Language Models with Mixture of Expert
Yuting Gao, Wang Lan, Hengyuan Zhao +3
Multimodal Mixture-of-Experts (MoE) models offer a promising path toward scalable and efficient large vision-language systems. However, existing approaches rely on rigid routing st…