4 papers
Serving Chain-structured Jobs with Large Memory Footprints with Application to Large Foundation Model Serving
Tingyang Sun, Ting He, I-Hong Hou
As a current trend in Artificial Intelligence (AI), large foundation models are increasingly employed as the core of AI services. However, even after training, serving such models…
Optimizing Resource Allocation for Geographically-Distributed Inference by Large Language Models
Tingyang Sun, Ting He, Bo Ji +1
Large language models have demonstrated extraordinary performance in many AI tasks but are expensive to use, even after training, due to their requirement of high-end GPUs. Recentl…
Communication Optimization for Decentralized Learning atop Bandwidth-limited Edge Networks
Tingyang Sun, Tuan Nguyen, Ting He
Decentralized federated learning (DFL) is a promising machine learning paradigm for bringing artificial intelligence (AI) capabilities to the network edge. Running DFL on top of ed…
Overlay-based Decentralized Federated Learning in Bandwidth-limited Networks
Yudi Huang, Tingyang Sun, Ting He
The emerging machine learning paradigm of decentralized federated learning (DFL) has the promise of greatly boosting the deployment of artificial intelligence (AI) by directly lear…