Heavy-ball Algorithms Always Escape Saddle Points

Tao Sun, Dongsheng Li, Zhe Quan +3

Nonconvex optimization algorithms with random initialization have attracted increasing attention recently. It has been showed that many first-order methods always avoid saddle poin…