Penalized maximum likelihood estimation and variable selection in geostatistics

Abstract

We consider the problem of selecting covariates in spatial linear models with Gaussian process errors. Penalized maximum likelihood estimation (PMLE) that enables simultaneous variable selection and parameter estimation is developed and, for ease of computation, PMLE is approximated by one-step sparse estimation (OSE). To further improve computational efficiency, particularly with large sample sizes, we propose penalized maximum covariance-tapered likelihood estimation (PMLE${}_{\mathrm{T}}$) and its one-step sparse estimation (OSE${}_{\mathrm{T}}$). General forms of penalty functions with an emphasis on smoothly clipped absolute deviation are used for penalized maximum likelihood. Theoretical properties of PMLE and OSE, as well as their approximations PMLE${}_{\mathrm{T}}$ and OSE${}_{\mathrm{T}}$ using covariance tapering, are derived, including consistency, sparsity, asymptotic normality and the oracle properties. For covariance tapering, a by-product of our theoretical results is consistency and asymptotic normality of maximum covariance-tapered likelihood estimates. Finite-sample properties of the proposed methods are demonstrated in a simulation study and, for illustration, the methods are applied to analyze two real data sets.

Published in at http://dx.doi.org/10.1214/11-AOS919 the Annals of Statistics (http://www.imstat.org/aos/) by the Institute of Mathematical Statistics (http://www.imstat.org)

References in corpus (14)

• Discussion of "Least angle regression" by Efron et al
• Rejoinder to "Least angle regression" by Efron et al
• Least Angle Regression
• Discussion of "Least angle regression" by Efron et al
• Discussion of "Least angle regression" by Efron et al
• Discussion of "Least angle regression" by Efron et al
• Discussion of "Least angle regression" by Efron et al
• Discussion of "Least angle regression" by Efron et al
• Discussion of "Least angle regression" by Efron et al
• Discussion of "Least angle regression" by Efron et al
• Nonconcave penalized likelihood with a diverging number of parameters
• One-step sparse estimates in nonconcave penalized likelihood models
• Fixed-domain asymptotic properties of tapered maximum likelihood estimators
• Penalized maximum likelihood estimation and variable selection in geostatistics

Cited by in corpus (7)

• Penalized maximum likelihood estimation and variable selection in geostatistics
• Adaptive LASSO estimation for functional hidden dynamic geostatistical model
• Estimation of the Spatial Weighting Matrix for Spatiotemporal Data under the Presence of Structural Breaks
• A review of regularised estimation methods and cross-validation in spatiotemporal statistics
• Regularized Nonlinear Regression with Dependent Errors and its Application to a Biomechanical Model
• High Dimensional Classification for Spatially Dependent Data with Application to Neuroimaging
• Non-separable Models with High-dimensional Data