Accelerating OpenPangu Inference on NPU via Speculative Decoding

Yuntao Dai, Jing Wu, Hang Gu +1

To mitigate the Memory Wall bottleneck encountered by Large Language Models (LLMs) during inference on \textbf{NPU} hardware, and addressing the scarcity of native support for main…