Revisiting the Constant Stepsize Stochastic Approximation with Decision-Dependent Markovian Noise

Hadi Hadavi, Wenlong Mou, Sergey Samsonov +1

We revisit the convergence analysis of constant stepsize stochastic approximation (SA) with decision-dependent Markovian noise, with a focus on characterizing the stationary bias a…