Showing cs.DCShow all
3 papers · 1 filter
cs.DC2026
Modular Foundation Model Inference at the Edge: Network-Aware Microservice Optimization
Juan Zhu, Zixin Wang, Shenghui Song +2
Foundation models (FMs) unlock unprecedented multimodal and multitask intelligence, yet their cloud-centric deployment precludes real-time responsiveness and compromises user priva…
cs.DC2025
Communication-Efficient Distributed On-Device LLM Inference Over Wireless Networks
Kai Zhang, Hengtao He, Shenghui Song +2
Large language models (LLMs) have demonstrated remarkable success across various application domains, but their enormous sizes and computational demands pose significant challenges…
cs.DC2025
Distributed On-Device LLM Inference With Over-the-Air Computation
Kai Zhang, Hengtao He, Shenghui Song +2
Large language models (LLMs) have achieved remarkable success across various artificial intelligence tasks. However, their enormous sizes and computational demands pose significant…