2 papers
cs.CL2026
Sparse Attention Remapping with Clustering for Efficient LLM Decoding on PIM
Zehao Fan, Garrett Gagnon, Zhenyu Liu +1
Transformer-based models are the foundation of modern machine learning, but their execution, particularly during autoregressive decoding in large language models (LLMs), places sig…
cs.LG2025
Bandwidth-Efficient Adaptive Mixture-of-Experts via Low-Rank Compensation
Zhenyu Liu, Yunzhen Liu, Zehao Fan +5
Mixture-of-Experts (MoE) models scale capacity via sparse activation but stress memory and bandwidth. Offloading alleviates GPU memory by fetching experts on demand, yet token-leve…