Modeling Music as a Time-Frequency Image: A 2D Tokenizer for Music Generation

Yuqing Cheng, Xingyu Ma, Guochen Yu +1

Autoregressive music generation depends strongly on the audio tokenizer. Existing high-fidelity codecs often use residual multi-codebook quantization, which preserves reconstructio…