Showing cs.DCShow all
2 papers · 1 filter
cs.DC2026
Serving Chain-structured Jobs with Large Memory Footprints with Application to Large Foundation Model Serving
Tingyang Sun, Ting He, I-Hong Hou
As a current trend in Artificial Intelligence (AI), large foundation models are increasingly employed as the core of AI services. However, even after training, serving such models…
cs.DC2025
Optimizing Resource Allocation for Geographically-Distributed Inference by Large Language Models
Tingyang Sun, Ting He, Bo Ji +1
Large language models have demonstrated extraordinary performance in many AI tasks but are expensive to use, even after training, due to their requirement of high-end GPUs. Recentl…