Masked Autoencoders that Listen

Po-Yao Huang, Hu Xu, Juncheng Li +5

This paper studies a simple extension of image-based Masked Autoencoders (MAE) to self-supervised representation learning from audio spectrograms. Following the Transformer encoder…