Accelerated Algorithms for Nonlinear Matrix Decomposition with the ReLU function

Giovanni Seraghiti, Atharva Awari, Arnaud Vandaele +2

In this paper, we study the following nonlinear matrix decomposition (NMD) problem: given a sparse nonnegative matrix $X$, find a low-rank matrix $\Theta$ such that $X\approx f(\Theta )$, wh…