Rejoinder on: Minimal penalties and the slope heuristics: a survey
arXiv:1909.13499
Abstract
This text is the rejoinder following the discussion of a survey paper about minimal penalties and the slope heuristics (Arlot, 2019. Minimal penalties and the slope heuristics: a survey. Journal de la SFDS). While commenting on the remarks made by the discussants, it provides two new results about the slope heuristics for model selection among a collection of projection estimators in least-squares fixed-design regression. First, we prove that the slope heuristics works even when all models are significantly biased. Second, when the noise is Gaussian with a general dependence structure, we compute expectations of key quantities, showing that the slope heuristics certainly is valid in this setting also.
References in corpus (4)
- Matrix estimation by Universal Singular Value Thresholding
- Optimal model selection for density estimation of stationary data under various mixing conditions
- The cost-free nature of optimally tuning Tikhonov regularizers and other ordered smoothers
- Oracle approach and slope heuristic in context tree estimation