4 papers
Synbols: Probing Learning Algorithms with Synthetic Datasets
Alexandre Lacoste, Pau Rodríguez, Frédéric Branchaud-Charron +7
Progress in the field of machine learning has been fueled by the introduction of benchmark datasets pushing the limits of existing algorithms. Enabling the design of datasets to te…
Online Fast Adaptation and Knowledge Accumulation: a New Approach to Continual Learning
Massimo Caccia, Pau Rodriguez, Oleksiy Ostapenko +8
Continual learning studies agents that learn from streams of tasks without forgetting previous ones while adapting to new ones. Two recent continual-learning scenarios have opened…
Online Continual Learning with Maximally Interfered Retrieval
Rahaf Aljundi, Lucas Caccia, Eugene Belilovsky +4
Continual learning, the setting where a learning agent is faced with a never ending stream of data, continues to be a great challenge for modern machine learning systems. In partic…
Language GANs Falling Short
Massimo Caccia, Lucas Caccia, William Fedus +3
Generating high-quality text with sufficient diversity is essential for a wide range of Natural Language Generation (NLG) tasks. Maximum-Likelihood (MLE) models trained with teache…