AudioCALM: Continuous Autoregressive Language Modeling for Universal Audio Generation

Huadai Liu, Kaicheng Luo, Wen Wang +4

Unifying speech, sound, and music generation in one model is hindered by tradeoffs between fidelity, end-to-end training, in-context conditioning, and variable-length synthesis tha…