A Saddle Point Remedy: Power of Variable Elimination in Non-convex Optimization

Min Gan, Guang-Yong Chen, Yang Yi +1

The proliferation of saddle points, rather than poor local minima, is increasingly understood to be a primary obstacle in large-scale non-convex optimization for machine learning.…