Zen-Attention: A Compiler Framework for Dynamic Attention Folding on AMD NPUs

Aadesh Deshmukh, Venkata Yaswanth Raparti, Samuel Hsu

Transformer-based deep learning models are increasingly deployed on energy, and DRAM bandwidth constrained devices such as laptops and gaming consoles, which presents significant c…