Estimator selection: a new method with applications to kernel density estimation

Abstract

Estimator selection has become a crucial issue in non parametric estimation. Two widely used methods are penalized empirical risk minimization (such as penalized log-likelihood estimation) or pairwise comparison (such as Lepski's method). Our aim in this paper is twofold. First we explain some general ideas about the calibration issue of estimator selection methods. We review some known results, putting the emphasis on the concept of minimal penalty which is helpful to design data-driven selection criteria. Secondly we present a new method for bandwidth selection within the framework of kernel density density estimation which is in some sense intermediate between these two main methods mentioned above. We provide some theoretical results which lead to some fully data-driven selection strategy.

References in corpus (2)

• Universal pointwise selection rule in multivariate function estimation
• Structural adaptation via $L_p$-norm oracle inequalities

Cited by in corpus (15)

• Nonparametric estimation for interacting particle systems : McKean-Vlasov models
• Sparse Travel Time Estimation from Streaming Data
• Minimal penalties and the slope heuristics: a survey
• Nadaraya-Watson Estimator for I.I.D. Paths of Diffusion Processes
• The density of expected persistence diagrams and its kernel based estimation
• A purely mechanical model with asymmetric features for early morphogenesis of rod-shaped bacteria micro-colony
• Bandwidth Selection for the Wolverton-Wagner Estimator
• On a Nadaraya-Watson Estimator with Two Bandwidths
• Nonparametric Drift Estimation from Diffusions with Correlated Brownian Motions
• Nonparametric estimation of the fragmentation kernel based on a PDE stationary distribution approximation
• Kernel Selection in Nonparametric Regression
• Nonparametric Estimation of the Transition Density Function for Diffusion Processes
• Adaptive directional estimator of the density in R^d for independent and mixing sequences
• Local polynomial estimation of the intensity of a doubly stochastic Poisson process with bandwidth selection procedure
• Projection Estimators of the Stationary Density of a Differential Equation Driven by the Fractional Brownian Motion