Competing Mutual Information Constraints with Stochastic Competition-based Activations for Learning Diversified Representations

Konstantinos P. Panousis, Anastasios Antoniadis, Sotirios Chatzis

This work aims to address the long-established problem of learning diversified representations. To this end, we combine information-theoretic arguments with stochastic competition-…