11 citations · 11 across the 5 of their papers we have counts for
4 papers · 1 filter
LUMEN: Coordinated Failure Recovery for Distributed LLM Serving
Zhang Cao, Shujie Han, Juncheng Zhang +3
Modern large language model (LLM) serving clusters distribute inference requests across multiple worker processes on different GPUs, but failures are prevalent at scale. When a wor…
TierCheck: Tiered Checkpointing for Fault Tolerance in Large Language Model Training
Shujie Han, Feng Jiang, Patrick P. C. Lee +5
Large Language Model (LLM) training is frequently interrupted by a heterogeneous spectrum of failures, from common GPU crashes to catastrophic cluster-wide outages. Existing checkp…
BSODiag: A Global Diagnosis Framework for Batch Servers Outage in Large-scale Cloud Infrastructure Systems
Tao Duan, Runqing Chen, Pinghui Wang +5
Cloud infrastructure is the collective term for all physical devices within cloud systems. Failures within the cloud infrastructure system can severely compromise the stability and…
The Design and Implementation of a High-Performance Log-Structured RAID System for ZNS SSDs
Jinhong Li, Yiyang Geng, Qiuping Wang +2
Zoned Namespace (ZNS) defines a new abstraction for host software to flexibly manage storage in flash-based SSDs as append-only zones. It also provides a Zone Append primitive to f…