Phase Transitions in Rate Distortion Theory and Deep Learning

Philipp Grohs, Andreas Klotz, Felix Voigtlaender

Rate distortion theory is concerned with optimally encoding a given signal class $\mathcal{S}$ using a budget of $R$ bits, as $R\to \infty$. We say that $\mathcal{S}$ can be compres…