Informational Frustration in Neural Manifolds: Shannon Bottlenecks and the Limits of Learnability

Srinivasa Rao P., Vangmayi P Reddy

Why overparameterised deep networks generalise so remarkably well remains one of the most stubborn open questions in machine learning theory. Classical frameworks like VC dimension…