Regularized Tyler's Scatter Estimator: Existence, Uniqueness, and Algorithms

Abstract

This paper considers the regularized Tyler's scatter estimator for elliptical distributions, which has received considerable attention recently. Various types of shrinkage Tyler's estimators have been proposed in the literature and proved work effectively in the "small n large p" scenario. Nevertheless, the existence and uniqueness properties of the estimators are not thoroughly studied, and in certain cases the algorithms may fail to converge. In this work, we provide a general result that analyzes the sufficient condition for the existence of a family of shrinkage Tyler's estimators, which quantitatively shows that regularization indeed reduces the number of required samples for estimation and the convergence of the algorithms for the estimators. For two specific shrinkage Tyler's estimators, we also proved that the condition is necessary and the estimator is unique. Finally, we show that the two estimators are actually equivalent. Numerical algorithms are also derived based on the majorization-minimization framework, under which the convergence is analyzed systematically.

References in corpus (4)

• Robust Shrinkage Estimation of High-dimensional Covariance Matrices
• Generalized robust shrinkage estimator and its application to STAP detection problem
• Large Dimensional Analysis and Optimization of Robust Shrinkage Covariance Matrix Estimators
• A Majorization-Minimization Algorithm for Computing the Karcher Mean of Positive Definite Matrices

Cited by in corpus (19)

• Forecasting Time Series with VARMA Recursions on Graphs
• An Overview of Robust Subspace Recovery
• Robust Estimation of Structured Covariance Matrix for Heavy-Tailed Elliptical Distributions
• Optimal shrinkage covariance matrix estimation under random sampling from elliptical distributions
• Robust Sparse Covariance Estimation by Thresholding Tyler's M-Estimator
• Simultaneous penalized M-estimation of covariance matrices using geodesically convex optimization
• Regularized Covariance Estimation for Polarization Radar Detection in Compound Gaussian Sea Clutter
• New insights into the statistical properties of $M$-estimators
• On the asymptotics of Maronna's robust PCA
• Optimal Design of the Adaptive Normalized Matched Filter Detector
• Large-dimensional behavior of regularized Maronna's M-estimators of covariance matrices
• Dynamic Shrinkage Estimation of the High-Dimensional Minimum-Variance Portfolio
• Convergence and Fluctuations of Regularized Tyler Estimators
• R-NL: Covariance Matrix Estimation for Elliptical Distributions based on Nonlinear Shrinkage
• Riemannian optimization for non-centered mixture of scaled Gaussian distributions
• Robust self-tuning semiparametric PCA for contaminated elliptical distribution
• Tyler's and Maronna's M-estimators: Non-Asymptotic Concentration Results
• Cross-Validated Tuning of Shrinkage Factors for MVDR Beamforming Based on Regularized Covariance Matrix Estimation
• Breakdown points of penalized and hybrid M-estimators of covariance