OmniLearn: A Framework for Distributed Deep Learning over Heterogeneous Clusters

Sahil Tyagi, Prateek Sharma

Deep learning systems are optimized for clusters with homogeneous resources. However, heterogeneity is prevalent in computing infrastructure across edge, cloud and HPC. When traini…