3 papers
math.OC2026
Incremental Aggregation on the Grassmannian for Asynchronous Eigenspace Computation
Xiaolu Wang, Jiang Hu, Hoi-To Wai
We study asynchronous optimization for finite-sum eigenspace computation in heterogeneous distributed systems. The theoretical foundations for asynchronous eigenspace computation r…
cs.LG2024
Dual-Delayed Asynchronous SGD for Arbitrarily Heterogeneous Data
Xiaolu Wang, Yuchang Sun, Hoi-To Wai +1
We consider the distributed learning problem with data dispersed across multiple workers under the orchestration of a central server. Asynchronous Stochastic Gradient Descent (SGD)…
math.OC2023
Linear Speedup of Incremental Aggregated Gradient Methods on Streaming Data
Xiaolu Wang, Cheng Jin, Hoi-To Wai +1
This paper considers a type of incremental aggregated gradient (IAG) method for large-scale distributed optimization. The IAG method is well suited for the parameter server archite…