Linear Speedup of Incremental Aggregated Gradient Methods on Streaming Data

Xiaolu Wang, Cheng Jin, Hoi-To Wai +1

This paper considers a type of incremental aggregated gradient (IAG) method for large-scale distributed optimization. The IAG method is well suited for the parameter server archite…