Frequency-Guided Masking for Enhanced Vision Self-Supervised Learning

Amin Karimi Monsefi, Mengxi Zhou, Nastaran Karimi Monsefi +3

We present a novel frequency-based Self-Supervised Learning (SSL) approach that significantly enhances its efficacy for pre-training. Prior work in this direction masks out pre-def…