Which Tasks Survive Self-Supervised Learning?

Achleshwar Luthra, Lucas Bryant, Tracy Zhu +1

Same-instance self-supervised learning (SSL) learns representations by enforcing consistency across two views of the same underlying instance. This principle alone, however, does n…