SWIFT: Expedited Failure Recovery for Large-scale DNN Training

Yuchen Zhong, Guangming Sheng, Juncheng Liu +2

As the size of deep learning models gets larger and larger, training takes longer time and more resources, making fault tolerance more and more critical. Existing state-of-the-art…