54 citations · 124 across the 19 of their papers we have counts for
3 papers · 1 filter
Understanding the Behaviour of the Empirical Cross-Entropy Beyond the Training Distribution
Matias Vera, Pablo Piantanida, Leonardo Rey Vega
Machine learning theory has mostly focused on generalization to samples from the same distribution as the training data. Whereas a better understanding of generalization beyond the…
The Role of Information Complexity and Randomization in Representation Learning
Matías Vera, Pablo Piantanida, Leonardo Rey Vega
A grand challenge in representation learning is to learn the different explanatory factors of variation behind the high dimen- sional data. Encoder models are often determined to o…
Compression-Based Regularization with an Application to Multi-Task Learning
Matías Vera, Leonardo Rey Vega, Pablo Piantanida
This paper investigates, from information theoretic grounds, a learning problem based on the principle that any regularity in a given dataset can be exploited to extract compact fe…