Joint Training Across Multiple Activation Sparsity Regimes

Haotian Wang

Generalization in deep neural networks remains only partially understood. Inspired by the stronger generalization tendency of biological systems, we explore the hypothesis that rob…