2 citations · 3 across the 12 of their papers we have counts for
Showing 2024 · cs.DCShow all
3 papers · 2 filters
cs.DC2024★ 2 cited
FALCON: Pinpointing and Mitigating Stragglers for Large-Scale Hybrid-Parallel Training
Tianyuan Wu, Wei Wang, Yinghao Yu +7
Fail-slows, or stragglers, are common but largely unheeded problems in large-scale hybrid-parallel training that spans thousands of GPU servers and runs for weeks to months. Yet, t…
cs.DC2024
SwiftDiffusion: Efficient Diffusion Model Serving with Add-on Modules
Suyi Li, Lingyun Yang, Xiaoxiao Jiang +12
Text-to-image (T2I) generation using diffusion models has become a blockbuster service in today's AI cloud. A production T2I service typically involves a serving workflow where a b…
cs.DC2024★ 1 cited
CaraServe: CPU-Assisted and Rank-Aware LoRA Serving for Generative LLM Inference
Suyi Li, Hanfeng Lu, Tianyuan Wu +6
Pre-trained large language models (LLMs) often need specialization for domain-specific tasks. Low-Rank Adaptation (LoRA) is a popular approach that adapts a base model to multiple…