Melody Guidance for Audio Diffusion Models Without Retraining

Cristobal Andrade, Sebastian J. Schlecht, Ben Maman +1

Controlling melody in audio generation normally requires training a conditional generative model on audio paired with pitch curves or MIDI notes. We instead guide an existing uncon…