8 papers
D-Composer: Language Modeling for Simultaneous Drum Transcription and Sound Event Decomposition
Patrick O'Reilly, Saumya Pailwan, Annie Chu +2
Drum beats are often conceptualized and produced as arrangements of repeated single-drum sound events or one-shots. Drum Analysis-by-Synthesis (AbS) models combine this structural…
Smorph: Playable Sound Morphing with Diffusion Models
Annie Chu, Hugo Flores García, Johannes Imort +5
Sound morphing, generating intermediate sounds that transition from one sonic identity to another, can be a powerful tool for musical sound design. Existing diffusion-based morphin…
FXplorer: A Map-Based Interface for Exploratory Audio Effect Design
Annie Chu, Jason Brent Smith, Bryan Pardo
Audio effects (FX) shape sound in contemporary music practice. However, most interfaces present them as discrete modules and parameters that favor targeted adjustment over explorat…
Mix2Morph: Learning Sound Morphing from Noisy Mixes
Annie Chu, Hugo Flores García, Oriol Nieto +3
We introduce Mix2Morph, a text-to-audio diffusion model fine-tuned to perform sound morphing without a dedicated dataset of morphs. By finetuning on noisy surrogate mixes at higher…
Ethics Statements in AI Music Papers: The Effective and the Ineffective
Julia Barnett, Patrick O'Reilly, Jason Brent Smith +2
While research in AI methods for music generation and analysis has grown in scope and impact, AI researchers' engagement with the ethical consequences of this work has not kept pac…
The Rhythm In Anything: Audio-Prompted Drums Generation with Masked Language Modeling
Patrick O'Reilly, Julia Barnett, Hugo Flores García +4
Musicians and nonmusicians alike use rhythmic sound gestures, such as tapping and beatboxing, to express drum patterns. While these gestures effectively communicate musical ideas,…
Sound Check: Auditing Audio Datasets
William Agnew, Julia Barnett, Annie Chu +6
Generative audio models are rapidly advancing in both capabilities and public utilization -- several powerful generative audio models have readily available open weights, and some…
Text2FX: Harnessing CLAP Embeddings for Text-Guided Audio Effects
Annie Chu, Patrick O'Reilly, Julia Barnett +1
This work introduces Text2FX, a method that leverages CLAP embeddings and differentiable digital signal processing to control audio effects, such as equalization and reverberation,…