3 papers
cs.DC2026
Serving Chain-structured Jobs with Large Memory Footprints with Application to Large Foundation Model Serving
Tingyang Sun, Ting He, I-Hong Hou
As a current trend in Artificial Intelligence (AI), large foundation models are increasingly employed as the core of AI services. However, even after training, serving such models…
cs.DC2025
Optimizing Resource Allocation for Geographically-Distributed Inference by Large Language Models
Tingyang Sun, Ting He, Bo Ji +1
Large language models have demonstrated extraordinary performance in many AI tasks but are expensive to use, even after training, due to their requirement of high-end GPUs. Recentl…
cs.NI2025
Communication Optimization for Decentralized Learning atop Bandwidth-limited Edge Networks
Tingyang Sun, Tuan Nguyen, Ting He
Decentralized federated learning (DFL) is a promising machine learning paradigm for bringing artificial intelligence (AI) capabilities to the network edge. Running DFL on top of ed…