Contour regression: A general approach to dimension reduction

Abstract

We propose a novel approach to sufficient dimension reduction in regression, based on estimating contour directions of small variation in the response. These directions span the orthogonal complement of the minimal space relevant for the regression and can be extracted according to two measures of variation in the response, leading to simple and general contour regression (SCR and GCR) methodology. In comparison with existing sufficient dimension reduction techniques, this contour-based methodology guarantees exhaustive estimation of the central subspace under ellipticity of the predictor distribution and mild additional assumptions, while maintaining \sqrtn-consistency and computational ease. Moreover, it proves robust to departures from ellipticity. We establish population properties for both SCR and GCR, and asymptotic properties for SCR. Simulations to compare performance with that of standard techniques such as ordinary least squares, sliced inverse regression, principal Hessian directions and sliced average variance estimation confirm the advantages anticipated by the theoretical analyses. We demonstrate the use of contour-based methods on a data set concerning soil evaporation.

Published at http://dx.doi.org/10.1214/009053605000000192 in the Annals of Statistics (http://www.imstat.org/aos/) by the Institute of Mathematical Statistics (http://www.imstat.org)

Cited by in corpus (20)

• Kernel dimension reduction in regression
• Coordinate-independent sparse sufficient dimension reduction and variable selection
• On dimension folding of matrix- or array-valued statistical objects
• Principal support vector machines for linear and nonlinear sufficient dimension reduction
• Efficient estimation in sufficient dimension reduction
• A general theory for nonlinear sufficient dimension reduction: Formulation and estimation
• Sufficient dimension reduction based on an ensemble of minimum average variance estimators
• Dimension reduction based on constrained canonical correlation and variable filtering
• Contour projected dimension reduction
• Model-based SIR for dimension reduction
• An adaptive composite quantile approach to dimension reduction
• On efficient dimension reduction with respect to a statistical functional of interest
• On surrogate dimension reduction for measurement error regression: An invariance law
• Central Quantile Subspace
• Roweis Discriminant Analysis: A Generalized Subspace Learning Method
• Minimum Average Deviance Estimation for Sufficient Dimension Reduction
• Polynomial Ridge Flowfield Estimation
• Projection pursuit based on Gaussian mixtures and evolutionary algorithms
• Nonlinear generalization of the monotone single index model
• Theoretical properties of Cook's PFC dimension reduction algorithm for linear regression