Higher-Order Equilibrium Tracking for EM-Compressible Online Estimation

ZhiMing Li, Yue Song

We study online estimation in latent-variable models by recasting the problem as tracking a moving empirical equilibrium. Standard online EM and stochastic approximation analyses p…