Only sparsity based loss function for learning representations

Vivek Bakaraju, Kishore Reddy Konda

We study the emergence of sparse representations in neural networks. We show that in unsupervised models with regularization, the emergence of sparsity is the result of the input d…