Improving self-supervised representation learning via sequential adversarial masking

Dylan Sam, Min Bai, Tristan McKinney +1

Recent methods in self-supervised learning have demonstrated that masking-based pretext tasks extend beyond NLP, serving as useful pretraining objectives in computer vision. Howeve…