Linear Complexity Self-Supervised Learning for Music Understanding with Random Quantizer

Petros Vavaroutsos, Theodoros Palamas, Pantelis Vikatos

In recent years, foundation models have become very popular due to their exceptional performance, mainly in natural language (NLP) tasks where they were first introduced. These mod…