Tile-Level Activation Overlap for Efficient LLM Inference

Abhinav Jangda, Tyler Sorensen, Sebastian Burckhardt +3

SwiGLU is the dominant MLP activation in modern large language models, yet its intermediate tensor materialization costs 9-37% of MLP execution time. We present two complementary C…