On the Trade-off between Flatness and Optimization in Distributed Learning

Ying Cao, Zhaoxian Wu, Kun Yuan +1

This paper proposes a theoretical framework to evaluate and compare the performance of stochastic gradient algorithms for distributed learning in relation to their behavior around…