Improving Visual Representation Learning through Perceptual Understanding

Samyakh Tukra, Frederick Hoffman, Ken Chatfield

We present an extension to masked autoencoders (MAE) which improves on the representations learnt by the model by explicitly encouraging the learning of higher scene-level features…