How to Train your DNN: The Network Operator Edition

Abstract

Deep Neural Nets have hit quite a crest, But physical networks are where they must rest, And here we put them all to the test, To see which network optimization is best.

References in corpus (2)

• Revisiting Distributed Synchronous SGD
• Poseidon: An Efficient Communication Architecture for Distributed Deep Learning on GPU Clusters