161 citations · 349 across the 10 of their papers we have counts for
3 papers · 1 filter
In Search of Forgotten Domain Generalization
Prasanna Mayilvahanan, Roland S. Zimmermann, Thaddäus Wiedemer +4
Out-of-Domain (OOD) generalization is the ability of a model trained on one or more domains to generalize to unseen domains. In the ImageNet era of computer vision, evaluation sets…
InfoNCE: Identifying the Gap Between Theory and Practice
Evgenia Rusak, Patrik Reizinger, Attila Juhos +3
Prior theory work on Contrastive Learning via the InfoNCE loss showed that, under certain assumptions, the learned representations recover the ground-truth latent factors. We argue…
Effective pruning of web-scale datasets based on complexity of concept clusters
Amro Abbas, Evgenia Rusak, Kushal Tirumala +3
Utilizing massive web-scale datasets has led to unprecedented performance gains in machine learning models, but also imposes outlandish compute requirements for their training. In…