Guaranteeing Both Consensus and Optimality in Decentralized Nonconvex Optimization with Multiple Local Updates

Jie Liu, Zuang Wang, Yongqiang Wang

Scalable decentralized optimization in large-scale systems hinges on efficient communication. A common way to reduce communication overhead is to perform multiple local updates bet…