43 citations · 49 across the 5 of their papers we have counts for
3 papers · 1 filter
Fault-Tolerant Hybrid-Parallel Training at Scale with Reliable and Efficient In-memory Checkpointing
Yuxin Wang, Xueze Kang, Shaohuai Shi +8
To efficiently scale large model (LM) training, researchers transition from data parallelism (DP) to hybrid parallelism (HP) on GPU clusters, which frequently experience hardware a…
A Taxonomy and Survey on eScience as a Service in the Cloud
Amelie Chi Zhou, Bingsheng He, Shadi Ibrahim
Cloud computing has recently evolved as a popular computing infrastructure for many applications. Scientific computing, which was mainly hosted in private clusters and grids, has s…
Monetary Cost Optimizations for Hosting Workflow-as-a-Service in IaaS Clouds
Amelie Chi Zhou, Bingsheng He, Cheng Liu
Recently, we have witnessed workflows from science and other data-intensive applications emerging on Infrastructure-asa-Service (IaaS) clouds, and many workflow service providers o…