AL2: Progressive Activation Loss for Learning General Representations in Classification Neural Networks

Majed El Helou, Frederike Dümbgen, Sabine Süsstrunk

The large capacity of neural networks enables them to learn complex functions. To avoid overfitting, networks however require a lot of training data that can be expensive and time-…