Multilayer Dataflow: Orchestrate Butterfly Sparsity to Accelerate Attention Computation

Haibin Wu, Wenming Li, Kai Yan +9

Recent neural networks (NNs) with self-attention exhibit competitiveness across different AI domains, but the essential attention mechanism brings massive computation and memory de…