Showing cs.LGShow all
2 papers · 1 filter
cs.LG2023
ADMM Algorithms for Residual Network Training: Convergence Analysis and Parallel Implementation
Jintao Xu, Yifei Li, Wenxun Xing
We propose both serial and parallel proximal (linearized) alternating direction method of multipliers (ADMM) algorithms for training residual neural networks. In contrast to backpr…
cs.LG2022
Convergence Rates of Training Deep Neural Networks via Alternating Minimization Methods
Jintao Xu, Chenglong Bao, Wenxun Xing
Training deep neural networks (DNNs) is an important and challenging optimization problem in machine learning due to its non-convexity and non-separable structure. The alternating…