241 citations · 392 across the 9 of their papers we have counts for
Showing 2022Show all
2 papers · 1 filter
cs.LG2022★ 19 cited
Efficient Self-supervised Learning with Contextualized Target Representations for Vision, Speech and Language
Alexei Baevski, Arun Babu, Wei-Ning Hsu +1
Current self-supervised learning algorithms are often modality-specific and require large amounts of computational resources. To address these issues, we increase the training effi…
cs.LG2022★ 241 cited
data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Language
Alexei Baevski, Wei-Ning Hsu, Qiantong Xu +3
While the general idea of self-supervised learning is identical across modalities, the actual algorithms and objectives differ widely because they were developed with a single moda…