Estimation of a $k$-monotone density: limit distribution theory and the spline connection

Abstract

We study the asymptotic behavior of the Maximum Likelihood and Least Squares Estimators of a $k$-monotone density $g_0$ at a fixed point $x_0$ when $k>2$. We find that the $j$th derivative of the estimators at $x_0$ converges at the rate $n^{-(k-j)/(2k+1)}$ for $j=0,...,k-1$. The limiting distribution depends on an almost surely uniquely defined stochastic process $H_k$ that stays above (below) the $k$-fold integral of Brownian motion plus a deterministic drift when $k$ is even (odd). Both the MLE and LSE are known to be splines of degree $k-1$ with simple knots. Establishing the order of the random gap ${\tau }_n^{+}-{\tau }_n^{-}$, where ${\tau }_n^{\pm }$ denote two successive knots, is a key ingredient of the proof of the main results. We show that this ``gap problem'' can be solved if a conjecture about the upper bound on the error in a particular Hermite interpolation via odd-degree splines holds.

Published in at http://dx.doi.org/10.1214/009053607000000262 the Annals of Statistics (http://www.imstat.org/aos/) by the Institute of Mathematical Statistics (http://www.imstat.org)

References in corpus (2)

• Estimation of a $k$-monotone density: limit distribution theory and the spline connection
• Conjecture of error boundedness in a new Hermite interpolation problem via splines of odd-degree

Cited by in corpus (11)

• Maximum likelihood estimation of a log-concave density and its distribution function: Basic properties and uniform consistency
• Limit distribution theory for maximum likelihood estimation of a log-concave density
• Estimation of a $k$-monotone density: limit distribution theory and the spline connection
• Concentration rate and consistency of the posterior under monotonicity constraints
• Optimal rates of convergence for convex set estimation from support functions
• Estimation of a discrete probability under constraint of k-monotony
• On Convex Least Squares Estimation when the Truth is Linear
• Empirical priors and posterior concentration rates for a monotone density
• Exact Solutions in Log-Concave Maximum Likelihood Estimation
• Revisiting consistency of a recursive estimator of mixing distributions
• Log-concave density estimation in undirected graphical models