Showing cs.DCShow all
3 papers · 1 filter
cs.DC2026
Serving Chain-structured Jobs with Large Memory Footprints with Application to Large Foundation Model Serving
Tingyang Sun, Ting He, I-Hong Hou
As a current trend in Artificial Intelligence (AI), large foundation models are increasingly employed as the core of AI services. However, even after training, serving such models…
cs.DC2025
Optimizing Resource Allocation for Geographically-Distributed Inference by Large Language Models
Tingyang Sun, Ting He, Bo Ji +1
Large language models have demonstrated extraordinary performance in many AI tasks but are expensive to use, even after training, due to their requirement of high-end GPUs. Recentl…
cs.DC2025
S2M3: Split-and-Share Multi-Modal Models for Distributed Multi-Task Inference on the Edge
JinYi Yoon, JiHo Lee, Ting He +2
With the advancement of Artificial Intelligence (AI) towards multiple modalities (language, vision, speech, etc.), multi-modal models have increasingly been used across various app…