Prediction Under Imperfect Compression: A Theory of Approximate MDL

Qian Li, Xinyu Mao, Shang-Hua Teng +1

Minimum Description Length (MDL) formalizes the principle of Occam's razor by optimizing the total description length: $L(\mathrm{model})+L(\mathrm{data}|\mathrm{model})$. Fo…