Empowering Hybrid Attention Models on NPUs

Yinyuan Zhang, Daliang Xu, Xiaolong Huang +4

Hybrid attention models have emerged as a crucial architecture for Large Language Models (LLMs) (e.g., the Qwen3.5 and Kimi series). Their memory and computational efficiency make…