Prediction in functional linear regression

Abstract

There has been substantial recent work on methods for estimating the slope function in linear regression for functional data analysis. However, as in the case of more conventional finite-dimensional regression, much of the practical interest in the slope centers on its application for the purpose of prediction, rather than on its significance in its own right. We show that the problems of slope-function estimation, and of prediction from an estimator of the slope function, have very different characteristics. While the former is intrinsically nonparametric, the latter can be either nonparametric or semiparametric. In particular, the optimal mean-square convergence rate of predictors is $n^{-1}$, where $n$ denotes sample size, if the predictand is a sufficiently smooth function. In other cases, convergence occurs at a polynomial rate that is strictly slower than $n^{-1}$. At the boundary between these two regimes, the mean-square convergence rate is less than $n^{-1}$ by only a logarithmic factor. More generally, the rate of convergence of the predicted value of the mean response in the regression model, given a particular value of the explanatory variable, is determined by a subtle interaction among the smoothness of the predictand, of the slope function in the model, and of the autocovariance function for the distribution of explanatory variables.

Published at http://dx.doi.org/10.1214/009053606000000830 in the Annals of Statistics (http://www.imstat.org/aos/) by the Institute of Mathematical Statistics (http://www.imstat.org)

References in corpus (2)

• Generalized functional linear models
• Prediction in functional linear regression

Cited by in corpus (93)

• Prediction in functional linear regression
• Weakly dependent functional data
• A reproducing kernel Hilbert space approach to functional linear regression
• Smoothing splines estimators for functional linear regression
• Functional data analysis for density functions by transformation to a Hilbert space
• Single and multiple index functional regression models with nonparametric link
• Methodology and theory for partial least squares applied to functional data
• Grouped variable importance with random forests and application to multiple functional data analysis
• Machine Learning Uncertainty as a Design Material: A Post-Phenomenological Inquiry
• Estimation in functional linear quantile regression
• Review of Functional Data Analysis
• Augmented sparse principal component analysis for high dimensional data
• A Smooth and Locally Sparse Estimator for Functional Linear Regression via Functional SCAD Penalty
• A goodness-of-fit test for the functional linear model with scalar response
• Nonparametric inference in generalized functional linear models
• Factor models and variable selection in high-dimensional regression analysis
• Adaptive functional linear regression
• Nonlinear estimation for linear inverse problems with error in the operator
• Deciding the dimension of effective dimension reduction space for functional and high-dimensional data
• Varying-coefficient functional linear regression
• Functional linear regression with points of impact
• Wavelet-domain regression and predictive inference in psychiatric neuroimaging
• Asymptotic equivalence of functional linear regression and a white noise inverse problem
• A test of significance in functional quadratic regression
• Convergence Rates for Learning Linear Operators from Noisy Data
• Feature Selection for Functional Data
• Estimation in functional regression for general exponential families
• Unified Principal Component Analysis for Sparse and Dense Functional Data under Spatial Dependency
• Remaining Useful Life Estimation Using Functional Data Analysis
• Longitudinal Functional Models with Structured Penalties
• Elastic Functional Principal Component Regression
• Parameter tuning in pointwise adaptation using a propagation approach
• Functional time series prediction under partial observation of the future curve
• Conditional Independence Testing in Hilbert Spaces with Applications to Functional Data Analysis
• Regression Models Using Shapes of Functions as Predictors
• Sparse Functional Boxplots for Multivariate Curves
• On regularized polynomial functional regression
• Mixture regression for observational data, with application to functional regression models
• Projection-based nonparametric goodness-of-fit testing with functional covariates
• Bootstrap independence test for functional linear models
• FAStEN: An Efficient Adaptive Method for Feature Selection and Estimation in High-Dimensional Functional Regressions
• Functional Linear Regression with Mixed Predictors
• On rate optimal local estimation in functional linear model
• Projected Statistical Methods for Distributional Data on the Real Line with the Wasserstein Metric
• An operator learning perspective on parameter-to-observable maps
• Spatial Functional Linear Model and its Estimation Method
• PCA-based estimation for functional linear regression with functional responses
• Sparse Wavelet Estimation in Quantile Regression with Multiple Functional Predictors
• Local linear regression for functional data
• Shrinkage Estimation and Selection for Multiple Functional Regression
• A geometric approach to maximum likelihood estimation of the functional principal components from sparse longitudinal data
• A simple method to construct confidence bands in functional linear regression
• Principal components analysis for sparsely observed correlated functional data using a kernel smoothing approach
• Weighted least squares methods for prediction in the functional data linear model
• Longitudinal Dynamic Functional Regression
• A note on estimation in Hilbertian linear models
• Warped Functional Regression
• A Small-Uniform Statistic for the Inference of Functional Linear Regressions
• Adaptive nonparametric estimation in the functional linear model with functional output
• Optimal Global Test for Functional Regression
• Profile Estimation for Partial Functional Partially Linear Single-Index Model
• Wavelet-Based Scalar-on-Function Finite Mixture Regression Models
• Optimal Prediction in an Additive Functional Model
• Truncated Linear Models for Functional Data
• Functional Analysis of Variance for Hilbert-Valued Multivariate Fixed Effect Models
• Joint Curve Registration and Classification with Two-level Functional Models
• Non-asymptotic Adaptive Prediction in Functional Linear Models
• The effect of the spatial domain in FANOVA models with ARH(1) error term
• High-Dimensional Spatial Quantile Function-on-Scalar Regression
• Model Averaging Estimation for Partially Linear Functional Score Models
• Sparse logistic regression on functional data
• Optimal prediction for kernel-based semi-functional linear regression
• Functional linear regression with derivatives
• Convergence of Nonparametric Functional Regression Estimates with Functional Responses
• Detecting changes in functional linear models
• Structured penalties for functional linear models---partially empirical eigenvectors for regression
• Minimax Prediction for Functional Linear Regression with Functional Responses in Reproducing Kernel Hilbert Spaces
• Functional Partial Linear Model
• A Flexible Spatial Autoregressive Modelling Framework for Mixed Covariates of Multiple Data Types
• Dynamical multiple regression in function spaces, under kernel regressors, with ARH(1) errors
• Estimating Historical Functional Linear Models with a Nested Group Bridge Approach
• Bayesian Classification of Multiclass Functional Data
• Statistical classification for partially observed functional data via filtering
• Aggregating multiple types of complex data in stock market prediction: A model-independent framework
• Partial Least Squares for Functional Joint Models
• Wasserstein Regression
• Non-asymptotic Optimal Prediction Error for Growing-dimensional Partially Functional Linear Models
• Estimating Functional Linear Mixed-Effects Regression Models
• Operator Reproducing Kernel Hilbert Spaces
• A new RKHS-based global testing for functional linear model
• A randomness test for functional panels
• Generalized Matrix Decomposition Regression: Estimation and Inference for Two-way Structured Data
• Model Averaging by Cross-validation for Partially Linear Functional Additive Models