Understanding The Robustness of Self-supervised Learning Through Topic Modeling

Zeping Luo, Shiyou Wu, Cindy Weng +2

Self-supervised learning has significantly improved the performance of many NLP tasks. However, how can self-supervised learning discover useful representations, and why is it bett…