SoundBrush: Sound as a Brush for Visual Scene Editing

Kim Sung-Bin, Kim Jun-Seong, Junseok Ko +2

We propose SoundBrush, a model that uses sound as a brush to edit and manipulate visual scenes. We extend the generative capabilities of the Latent Diffusion Model (LDM) to incorpo…