Showing math.OCShow all
3 papers · 1 filter
math.OC2024
Finite-Time Decoupled Convergence in Nonlinear Two-Time-Scale Stochastic Approximation
Yuze Han, Xiang Li, Zhihua Zhang
In two-time-scale stochastic approximation (SA), two iterates are updated at varying speeds using different step sizes, with each update influencing the other. Previous studies on…
math.OC2023
Gradient Tracking for High Dimensional Federated Optimization
Jiadong Liang, Yang Peng, Zhihua Zhang
In this paper, we study the (decentralized) distributed optimization problem with high-dimensional sparse structure. Building upon the FedDA algorithm, we propose a (Decentralized)…
math.OC2023
Convergence and Inference of Stream SGD, with Applications to Queueing Systems and Inventory Control
Xiang Li, Jiadong Liang, Xinyun Chen +1
Stream stochastic gradient descent (SGD) is a simple and efficient method for solving online optimization problems in operations research (OR), where data is generated by parameter…