Verify Distributed Deep Learning Model Implementation Refinement with Iterative Relation Inference

Zhanghan Wang, Ding Ding, Hang Zhu +2

Distributed machine learning training and inference is common today because today's large models require more memory and compute than can be provided by a single GPU. Distributed m…