What does fault tolerant Deep Learning need from MPI?

Vinay Amatya, Abhinav Vishnu, Charles Siegel +1

Deep Learning (DL) algorithms have become the de facto Machine Learning (ML) algorithm for large scale data analysis. DL algorithms are computationally expensive - even distributed…