3 papers
math.NA2025
An Additively Preconditioned Trust Region Strategy for Machine Learning
Samuel Cruz AlegrÃa, Bindi Ãapriqi, Shega Likaj +2
Modern machine learning, especially the training of deep neural networks, depends on solving large-scale, highly nonconvex optimization problems, whose objective function exhibit a…
math.NA2025
Integrating Additive Multigrid with Multipreconditioned Conjugate Gradient Method
Hardik Kothari, Maria Giuseppina Chiara Nestola, Marco Favino +1
Due to its optimal complexity, the multigrid (MG) method is one of the most popular approaches for solving large-scale linear systems arising from the discretization of partial dif…
cs.LG2025
Data-Parallel Neural Network Training via Nonlinearly Preconditioned Trust-Region Method
Samuel A. Cruz AlegrÃa, Ken Trotti, Alena KopaniÄáková +1
Parallel training methods are increasingly relevant in machine learning (ML) due to the continuing growth in model and dataset sizes. We propose a variant of the Additively Precond…