287 citations · 599 across the 16 of their papers we have counts for
4 papers · 1 filter
Battle of the Backbones: A Large-Scale Comparison of Pretrained Models across Computer Vision Tasks
Micah Goldblum, Hossein Souri, Renkun Ni +10
Neural network based computer vision systems are typically built on a backbone, a pretrained or randomly initialized feature extractor. Several years ago, the default option was an…
MC-JEPA: A Joint-Embedding Predictive Architecture for Self-Supervised Learning of Motion and Content Features
Adrien Bardes, Jean Ponce, Yann LeCun
Self-supervised learning of visual representations has been focusing on learning content features, which do not capture object motion or location, and focus on identifying and diff…
No Free Lunch in Self Supervised Representation Learning
Ihab Bendidi, Adrien Bardes, Ethan Cohen +3
Self-supervised representation learning in computer vision relies heavily on hand-crafted image transformations to learn meaningful and invariant features. However few extensive ex…
A Cookbook of Self-Supervised Learning
Randall Balestriero, Mark Ibrahim, Vlad Sobal +16
Self-supervised learning, dubbed the dark matter of intelligence, is a promising path to advance machine learning. Yet, much like cooking, training SSL methods is a delicate art wi…