FlashAttention for Scalable Vector Architectures

Sonia Rani Gupta, Nikela Papadopoulou, Miquel Pericàs

Inference with transformer models on CPUs is increasingly important, especially for Small Language Models (SLMs), where vector architectures are emerging as a promising execution s…