A Selection Premium Decomposition for the Expected Maximum of Random Walks

Victor H. de la Pena, Fangyuan Lin, Victor K. de la Pena

When $K$ models are evaluated on the same validation set of size $n$, the selected winner's apparent performance is biased upward. Suppose $K$ models are evaluated on a shared sequ…