Edge Deployment of Small Language Models, a comprehensive comparison of CPU, GPU and NPU backends

Pablo Prieto, Pablo Abad

Edge computing processes data where it is generated, enabling faster decisions, lower bandwidth usage, and improved privacy. However, edge devices typically operate under strict co…