DINO-A: Adapting Self-Distillation Vision Transformers to General Audio Representation Learning

Tomasz Radzikowski, Mateusz Modrzejewski, Przemysław Rokita

We present DINO-A, an adaptation of self-distillation from vision to general audio representation learning. While DINO has become a canonical method in self-supervised vision and p…