Celeritas: Fast Optimizer for Large Dataflow Graphs

Hengwei Xu, Yong Liao, Haiyong Xie +1

The rapidly enlarging neural network models are becoming increasingly challenging to run on a single device. Hence model parallelism over multiple devices is critical to guarantee…