Optimal choice of $k$ for $k$-nearest neighbor regression

Mona Azadkia

The $k$-nearest neighbor algorithm ($k$-NN) is a widely used non-parametric method for classification and regression. We study the mean squared error of the $k$-NN estimator when $…