Global attractors and fast-slow reduction for finite-state actor-critic mean dynamics

Vladyslav Prytula

When a learning algorithm reshapes the data distribution it trains on, the long-run behavior depends on the joint evolution of the policy, the value estimate, and the data distribu…