TinyMusician: On-Device Music Generation with Knowledge Distillation and Mixed Precision Quantization

Hainan Wang, Mehdi Hosseinzadeh, Reza Rawassizadeh

The success of the generative model has gained unprecedented attention in the music generation area. Transformer-based architectures have set new benchmarks for model performance.…