Accelerated Gradient-free Neural Network Training by Multi-convex Alternating Optimization

Junxiang Wang, Hongyi Li, Liang Zhao

In recent years, even though Stochastic Gradient Descent (SGD) and its variants are well-known for training neural networks, it suffers from limitations such as the lack of theoret…