Online Statistical Inference for Nonlinear Stochastic Approximation with Markovian Data

Xiang Li, Jiadong Liang, Zhihua Zhang

Many stochastic approximation (SA) algorithms evolve along a single trajectory, making uncertainty quantification challenging under nonlinear dynamics and Markov dependence. We dev…