23 citations · 58 across the 11 of their papers we have counts for
3 papers · 1 filter
Checkmate: Zero-Overhead Model Checkpointing via Network Gradient Replication
Ankit Bhardwaj, Weiyang Wang, Jeremy Carin +2
This paper presents Checkmate, a system that enables per-iteration checkpointing in DNN training without any training slowdown. The traditional approach to checkpointing requires a…
Domain-specific Communication Optimization for Distributed DNN Training
Hao Wang, Jingrong Chen, Xinchen Wan +7
Communication overhead poses an important obstacle to distributed DNN training and draws increasing attention in recent years. Despite continuous efforts, prior solutions such as g…
Quantifying the Performance of Federated Transfer Learning
Qinghe Jing, Weiyan Wang, Junxue Zhang +2
The scarcity of data and isolated data islands encourage different organizations to share data with each other to train machine learning models. However, there are increasing conce…