Occam's Razor is Only as Sharp as Your ELBO

Ethan Harvey, Michael C. Hughes

The marginal likelihood, also known as the evidence, is regarded as a mathematical embodiment of Occam's razor, enabling model selection that avoids overfitting. The evidence lower…