Sparse Attention Remapping with Clustering for Efficient LLM Decoding on PIM

Zehao Fan, Garrett Gagnon, Zhenyu Liu +1

Transformer-based models are the foundation of modern machine learning, but their execution, particularly during autoregressive decoding in large language models (LLMs), places sig…