3 papers
cs.LG2024
Sum-of-norms regularized Nonnegative Matrix Factorization
Andersen Ang, Waqas Bin Hamed, Hans De Sterck
When applying nonnegative matrix factorization (NMF), the rank parameter is generally unknown. This rank, called the nonnegative rank, is usually estimated heuristically since comp…
cs.CL2023
Fast Multipole Attention: A Scalable Multilevel Attention Mechanism for Text and Images
Yanming Kang, Giang Tran, Hans De Sterck
While Transformer networks benefit from a global receptive field, their quadratic cost relative to sequence length restricts their application to long sequences and high-resolution…
math.OC2023
MGProx: A nonsmooth multigrid proximal gradient method with adaptive restriction for strongly convex optimization
Andersen Ang, Hans De Sterck, Stephen Vavasis
We study the combination of proximal gradient descent with multigrid for solving a class of possibly nonsmooth strongly convex optimization problems. We propose a multigrid proxima…