Matrix Completion and Low-Rank SVD via Fast Alternating Least Squares
arXiv:1410.2596
Abstract
The matrix-completion problem has attracted a lot of attention, largely as a result of the celebrated Netflix competition. Two popular approaches for solving the problem are nuclear-norm-regularized matrix approximation (Candes and Tao, 2009, Mazumder, Hastie and Tibshirani, 2010), and maximum-margin matrix factorization (Srebro, Rennie and Jaakkola, 2005). These two procedures are in some cases solving equivalent problems, but with quite different algorithms. In this article we bring the two approaches together, leading to an efficient algorithm for large matrix factorization and completion that outperforms both of these. We develop a software package "softImpute" in R for implementing our approaches, and a distributed version for very large matrices using the "Spark" cluster programming environment.
References in corpus (1)
Cited by in corpus (21)
- Nonconvex Optimization Meets Low-Rank Matrix Factorization: An Overview
- Guaranteed Matrix Completion via Non-convex Factorization
- Implicit Regularization in Nonconvex Statistical Estimation: Gradient Descent Converges Linearly for Phase Retrieval, Matrix Completion, and Blind Deconvolution
- Fighting Fire with Fire: Using Antidote Data to Improve Polarization and Fairness of Recommender Systems
- Semi-supervised Deep Generative Modelling of Incomplete Multi-Modality Emotional Data
- On the consistency of supervised learning with missing values
- Missing Data Imputation using Optimal Transport
- OPENMENDEL: A Cooperative Programming Project for Statistical Genetics
- Directivity Modes of Earthquake Populations with Unsupervised Learning
- Factorbird - a Parameter Server Approach to Distributed Matrix Factorization
- Data Imputation with Iterative Graph Reconstruction
- QUOTUS: The Structure of Political Media Coverage as Revealed by Quoting Patterns
- Orthogonal Inductive Matrix Completion
- Does imputation matter? Benchmark for predictive models
- Matrix completion and extrapolation via kernel regression
- Multi-Image Matching via Fast Alternating Minimization
- Multiple Imputation with Neural Network Gaussian Process for High-dimensional Incomplete Data
- Towards Better Modeling with Missing Data: A Contrastive Learning-based Visual Analytics Perspective
- Intelligent Initialization and Adaptive Thresholding for Iterative Matrix Completion; Some Statistical and Algorithmic Theory for Adaptive-Impute
- MFAI: A Scalable Bayesian Matrix Factorization Approach to Leveraging Auxiliary Information
- Co-factor analysis of citation networks