Dimer-Enhanced Optimization: A First-Order Approach to Escaping Saddle Points in Neural Network Training

Yue Hu, Zanxia Cao, Yingchao Liu

First-order optimization methods, such as SGD and Adam, are widely used for training large-scale deep neural networks due to their computational efficiency and robust performance.…