Investigating the Edge of Stability Phenomenon in Reinforcement Learning

Rares Iordan, Marc Peter Deisenroth, Mihaela Rosca

Recent progress has been made in understanding optimisation dynamics in neural networks trained with full-batch gradient descent with momentum with the uncovering of the edge of st…