Deep Learning Optimization Using Self-Adaptive Weighted Auxiliary Variables

Yaru Liu, Yiqi Gu, Michael K. Ng

In this paper, we develop a new optimization framework for the least squares learning problem via fully connected neural networks or physics-informed neural networks. The gradient…