DiffSynth-Music: Audio-Conditioned KV-Cache Adapters for Controllable Music Generation

Zhongjie Duan, Shengchuan Gao, Hong Zhang +1

Text and lyrics specify broad musical characteristics and sung content but offer limited control over musical timing, melody, and reference-based style. We introduce DiffSynth-Musi…