Understanding Generalization, Robustness, and Interpretability in Low-Capacity Neural Networks

Yash Kumar

Although modern deep learning often relies on massive over-parameterized models, the fundamental interplay between capacity, sparsity, and robustness in low-capacity networks remai…