Learning Capacity: A Measure of the Effective Dimensionality of a Model

Daiwei Chen, Wei-Kai Chang, Pratik Chaudhari

We use a formal correspondence between thermodynamics and inference, where the number of samples can be thought of as the inverse temperature, to study a quantity called ``learning…