New insights for the multivariate square-root lasso
arXiv:1909.05041
Abstract
We study the multivariate square-root lasso, a method for fitting the multivariate response linear regression model with dependent errors. This estimator minimizes the nuclear norm of the residual matrix plus a convex penalty. Unlike existing methods that require explicit estimates of the error precision (inverse covariance) matrix, the multivariate square-root lasso implicitly accounts for error dependence and is the solution to a convex optimization problem. We establish error bounds which reveal that like the univariate square-root lasso, the multivariate square-root lasso is pivotal with respect to the unknown error covariance matrix. In addition, we propose a variation of the alternating direction method of multipliers algorithm to compute the estimator and discuss an accelerated first order algorithm that can be applied in certain cases. In both simulation studies and a genomic data application, we show that the multivariate square-root lasso can outperform more computationally intensive methods that require explicit estimation of the error precision matrix.
arXiv commentAccepted for publication in Journal of Machine Learning Research
References in corpus (5)
- Square-Root Lasso: Pivotal Recovery of Sparse Signals via Conic Programming
- A sparse conditional Gaussian graphical model for analysis of genetical genomics data
- Uncertainty Principles and Vector Quantization
- An explicit mean-covariance parameterization for multivariate response linear regression
- Support recovery and sup-norm convergence rates for sparse pivotal estimation