Randomized coordinate gradient descent almost surely escapes strict saddle points

Ziang Chen, Yingzhou Li, Zihao Li

We analyze the behavior of randomized coordinate gradient descent for nonconvex optimization, proving that under standard assumptions, the iterates almost surely escape strict sadd…