2 papers
cs.SD2024
Parameter-Efficient Transfer Learning for Music Foundation Models
Yiwei Ding, Alexander Lerch
More music foundation models are recently being released, promising a general, mostly task independent encoding of musical information. Common ways of adapting music foundation mod…
cs.LG2024
Embedding Compression for Teacher-to-Student Knowledge Transfer
Yiwei Ding, Alexander Lerch
Common knowledge distillation methods require the teacher model and the student model to be trained on the same task. However, the usage of embeddings as teachers has also been pro…