11 citations · 34 across the 13 of their papers we have counts for
4 papers · 1 filter
The Role of Mutual Information in Variational Classifiers
Matias Vera, Leonardo Rey Vega, Pablo Piantanida
Overfitting data is a well-known phenomenon related with the generation of a model that mimics too closely (or exactly) a particular instance of data, and may therefore fail to pre…
Understanding the Behaviour of the Empirical Cross-Entropy Beyond the Training Distribution
Matias Vera, Pablo Piantanida, Leonardo Rey Vega
Machine learning theory has mostly focused on generalization to samples from the same distribution as the training data. Whereas a better understanding of generalization beyond the…
The Role of Information Complexity and Randomization in Representation Learning
Matías Vera, Pablo Piantanida, Leonardo Rey Vega
A grand challenge in representation learning is to learn the different explanatory factors of variation behind the high dimen- sional data. Encoder models are often determined to o…
Compression-Based Regularization with an Application to Multi-Task Learning
Matías Vera, Leonardo Rey Vega, Pablo Piantanida
This paper investigates, from information theoretic grounds, a learning problem based on the principle that any regularity in a given dataset can be exploited to extract compact fe…