Adaptive functional linear regression

Abstract

We consider the estimation of the slope function in functional linear regression, where scalar responses are modeled in dependence of random functions. Cardot and Johannes [J. Multivariate Anal. 101 (2010) 395-408] have shown that a thresholded projection estimator can attain up to a constant minimax-rates of convergence in a general framework which allows us to cover the prediction problem with respect to the mean squared prediction error as well as the estimation of the slope function and its derivatives. This estimation procedure, however, requires an optimal choice of a tuning parameter with regard to certain characteristics of the slope function and the covariance operator associated with the functional regressor. As this information is usually inaccessible in practice, we investigate a fully data-driven choice of the tuning parameter which combines model selection and Lepski's method. It is inspired by the recent work of Goldenshluger and Lepski [Ann. Statist. 39 (2011) 1608-1632]. The tuning parameter is selected as minimizer of a stochastic penalized contrast function imitating Lepski's method among a random collection of admissible values. This choice of the tuning parameter depends only on the data and we show that within the general framework the resulting data-driven thresholded projection estimator can attain minimax-rates up to a constant over a variety of classes of slope functions and covariance operators. The results are illustrated considering different configurations which cover in particular the prediction problem as well as the estimation of the slope and its derivatives. A simulation study shows the reasonable performance of the fully data-driven estimation procedure.

Published in at http://dx.doi.org/10.1214/12-AOS1050 the Annals of Statistics (http://www.imstat.org/aos/) by the Institute of Mathematical Statistics (http://www.imstat.org)

References in corpus (9)

• Prediction in functional linear regression
• Methodology and convergence rates for functional linear regression
• Smoothing splines estimators for functional linear regression
• Concentration around the mean for maxima of empirical processes
• Bandwidth selection in kernel density estimation: Oracle inequalities and adaptive minimax optimality
• Adaptive functional linear regression
• Nonlinear estimation for linear inverse problems with error in the operator
• Adaptive estimation in circular functional linear models
• On rate optimal local estimation in functional linear model

Cited by in corpus (11)

• Adaptive functional linear regression
• Functional linear regression with points of impact
• Asymptotic equivalence of functional linear regression and a white noise inverse problem
• PCA-based estimation for functional linear regression with functional responses
• A simple method to construct confidence bands in functional linear regression
• Adaptive non-parametric estimation in the presence of dependence
• Adaptive nonparametric estimation in the functional linear model with functional output
• Truncated Linear Models for Functional Data
• Aggregating multiple types of complex data in stock market prediction: A model-independent framework
• Hybrid Regularisation of Functional Linear Models
• A modeling approach to design a software sensor and analyze agronomical features - Application to sap flow and grape quality relationship