Finite-sample risk bounds for maximum likelihood estimation with arbitrary penalties

W. D. Brinda, Jason M. Klusowski

The MDL two-part coding $\text{index of resolvability}$ provides a finite-sample upper bound on the statistical risk of penalized likelihood estimators over countable models. H…