Understanding and Exploiting Diagonal Attention Sparsity in Autoregressive Image Generation

Daeun Kim, Junwha Hong, Changhun Oh +3

Autoregressive image generation has emerged as a paradigm for multimodal AI systems due to its compatibility with transformer-based LLM serving infrastructures. However, generating…