Showing cs.DCShow all
2 papers · 1 filter
cs.DC2026
Cascadia: A Control-Plane-Free Alternative to Hyperconverged AI Infrastructure
Matias Parij, Pawan Paudel, Tate Berenbaum +1
We present Cascadia, a system for serving large language models on fleets of commodity Intel AIPCs using their CPU, integrated-GPU, and NPU resources. Every node embeds ingress, sc…
cs.DC2026
Pre-Compiled Pipeline Shards for Distributed LLM Inference on Intel AI PC Fleets
Tate Berenbaum, Muthaiah Venkatachalam
Modern Intel AI PCs ship capable integrated GPUs and NPUs with 16+ GB of unified memory, and they spend considerable time idle. That is not enough memory to fit a large model such…