1 paper · 1 filter
Matias Parij, Pawan Paudel, Tate Berenbaum +1
We present Cascadia, a system for serving large language models on fleets of commodity Intel AIPCs using their CPU, integrated-GPU, and NPU resources. Every node embeds ingress, sc…