Masked Modeling Duo: Learning Representations by Encouraging Both Networks to Model the Input

Daisuke Niizumi, Daiki Takeuchi, Yasunori Ohishi +2

Masked Autoencoders is a simple yet powerful self-supervised learning method. However, it learns representations indirectly by reconstructing masked input patches. Several methods…