4 papers
bAdag: an adaptive block coordinate gradient method for smooth nonconvex functions
Giovanni Seraghiti
A new Block Coordinate Gradient (BCG) method, dubbed bAdag, for smooth, nonconvex minimization problem is proposed; it falls in the class of Objective Function Free Optimization (O…
Nonnegative Matrix Factorization in the Component-Wise L1 Norm for Sparse Data
Giovanni Seraghiti, Kévin Dubrulle, Arnaud Vandaele +1
Nonnegative matrix factorization (NMF) approximates a nonnegative matrix, , by the product of two nonnegative factors, , where has columns and has rows. In t…
An extrapolated and provably convergent algorithm for nonlinear matrix decomposition with the ReLU function
Nicolas Gillis, Margherita Porcelli, Giovanni Seraghiti
ReLU matrix decomposition (RMD) is the following problem: given a sparse, nonnegative matrix and a factorization rank , identify a rank- matrix such that $X\approx \…
prunAdag: an adaptive pruning-aware gradient method
Margherita Porcelli, Giovanni Seraghiti, Philippe L. Toint
A pruning-aware adaptive gradient method is proposed which classifies the variables in two sets before updating them using different strategies. This technique extends the ``releva…