Covariance Operator Estimation via Adaptive Thresholding

Abstract

This paper studies sparse covariance operator estimation for nonstationary processes with sharply varying marginal variance and small correlation lengthscale. We introduce a covariance operator estimator that adaptively thresholds the sample covariance function using an estimate of the variance component. Building on recent results from empirical process theory, we derive an operator norm bound on the estimation error in terms of the sparsity level of the covariance and the expected supremum of a normalized process. Our theory and numerical simulations demonstrate the advantage of adaptive threshold estimators over universal threshold and sample covariance estimators in nonstationary settings.

42 pages, 7 figures

References in corpus (16)

• Regularized estimation of large covariance matrices
• Covariance regularization by thresholding
• Operator norm consistent estimation of large-dimensional sparse covariance matrices
• Optimal rates of convergence for sparse covariance matrix estimation
• Adaptive covariance matrix estimation through block thresholding
• Covariance and precision matrix estimation for high-dimensional time series
• On the spectral norm of Gaussian random matrices
• Analysis of Stochastic Gradient Descent in Continuous Time
• Convergence Rates for Learning Linear Operators from Noisy Data
• Non-Asymptotic Analysis of Ensemble Kalman Updates: Effective Dimension and Localization
• Inference on covariance operators via concentration inequalities: k-sample tests, classification, and clustering via Rademacher complexities
• Ensemble Kalman Filters with Resampling
• Operator Learning: Algorithms and Analysis
• Learning linear operators: Infinite-dimensional regression as a well-behaved non-compact inverse problem
• Covariance Operator Estimation: Sparsity, Lengthscale, and Ensemble Kalman Filters
• Optimal Estimation of Structured Covariance Operators