6.4k citations · 7.6k across the 17 of their papers we have counts for
3 papers · 1 filter
Efficient Conditionally Invariant Representation Learning
Roman Pogodin, Namrata Deka, Yazhe Li +3
We introduce the Conditional Independence Regression CovariancE (CIRCE), a measure of conditional independence for multivariate continuous-valued variables. CIRCE applies as a regu…
Where Should I Spend My FLOPS? Efficiency Evaluations of Visual Pre-training Methods
Skanda Koppula, Yazhe Li, Evan Shelhamer +5
Self-supervised methods have achieved remarkable success in transfer learning, often achieving the same or better accuracy than supervised pre-training. Most prior work has done so…
Sequential Learning Of Neural Networks for Prequential MDL
Jorg Bornschein, Yazhe Li, Marcus Hutter
Minimum Description Length (MDL) provides a framework and an objective for principled model evaluation. It formalizes Occam's Razor and can be applied to data from non-stationary s…