Optimal Penalized Function-on-Function Regression under a Reproducing Kernel Hilbert Space Framework

Abstract

Many scientific studies collect data where the response and predictor variables are both functions of time, location, or some other covariate. Understanding the relationship between these functional variables is a common goal in these studies. Motivated from two real-life examples, we present in this paper a function-on-function regression model that can be used to analyze such kind of functional data. Our estimator of the 2D coefficient function is the optimizer of a form of penalized least squares where the penalty enforces a certain level of smoothness on the estimator. Our first result is the Representer Theorem which states that the exact optimizer of the penalized least squares actually resides in a data-adaptive finite dimensional subspace although the optimization problem is defined on a function space of infinite dimensions. This theorem then allows us an easy incorporation of the Gaussian quadrature into the optimization of the penalized least squares, which can be carried out through standard numerical procedures. We also show that our estimator achieves the minimax convergence rate in mean prediction under the framework of function-on-function regression. Extensive simulation studies demonstrate the numerical advantages of our method over the existing ones, where a sparse functional data extension is also introduced. The proposed method is then applied to our motivating examples of the benchmark Canadian weather data and a histone regulation study.

References in corpus (4)

• Functional linear regression analysis for longitudinal data
• A reproducing kernel Hilbert space approach to functional linear regression
• Methodology and theory for partial least squares applied to functional data
• Optimal estimation of the mean function based on discretely sampled functional data: Phase transition

Cited by in corpus (12)

• Smooth Lasso Estimator for the Function-on-Function Linear Regression Model
• Low-Rank Covariance Function Estimation for Multidimensional Functional Data
• Modern Non-Linear Function-on-Function Regression
• Sparse and Smooth Functional Data Clustering
• Functional Linear Regression with Mixed Predictors
• Functional instrumental variable regression with an application to estimating the impact of immigration on native wages
• Functional Autoregressive Processes in Reproducing Kernel Hilbert Spaces
• Functional L-Optimality Subsampling for Massive Data
• Interpretable discriminant analysis for functional data supported on random nonlinear domains with an application to Alzheimer's disease
• High-Dimensional Spatial Quantile Function-on-Scalar Regression
• Fast implementation of partial least squares for function-on-function regression
• A reproducing kernel Hilbert space framework for functional data classification