189 citations · 217 across the 8 of their papers we have counts for
8 papers
Hierarchical Generative Modeling of Melodic Vocal Contours in Hindustani Classical Music
Nithya Shikarpur, Krishna Maneesha Dendukuri, Yusong Wu +2
Hindustani music is a performance-driven oral tradition that exhibits the rendition of rich melodic patterns. In this paper, we focus on generative modeling of singers' vocal melod…
SingSong: Generating musical accompaniments from singing
Chris Donahue, Antoine Caillon, Adam Roberts +8
We present SingSong, a system that generates instrumental music to accompany input vocals, potentially offering musicians and non-musicians alike an intuitive new way to create mus…
MusicLM: Generating Music From Text
Andrea Agostinelli, Timo I. Denk, Zalán Borsos +10
We introduce MusicLM, a model generating high-fidelity music from text descriptions such as "a calming violin melody backed by a distorted guitar riff". MusicLM casts the process o…
Streamable Neural Audio Synthesis With Non-Causal Convolutions
Antoine Caillon, Philippe Esling
Deep learning models are mostly used in an offline inference fashion. However, this strongly limits the use of these models inside audio generation setups, as most creative workflo…
RAVE: A variational autoencoder for fast and high-quality neural audio synthesis
Antoine Caillon, Philippe Esling
Deep generative models applied to audio have improved by a large margin the state-of-the-art in many speech and music related tasks. However, as raw waveform modelling remains an i…
Timbre latent space: exploration and creative aspects
Antoine Caillon, Adrien Bitton, Brice Gatinet +1
Recent studies show the ability of unsupervised models to learn invertible audio representations using Auto-Encoders. They enable high-quality sound synthesis but a limited control…
Diet deep generative audio models with structured lottery
Philippe Esling, Ninon Devis, Adrien Bitton +3
Deep learning models have provided extremely successful solutions in most audio application fields. However, the high accuracy of these models comes at the expense of a tremendous…
Assisted Sound Sample Generation with Musical Conditioning in Adversarial Auto-Encoders
Adrien Bitton, Philippe Esling, Antoine Caillon +1
Generative models have thrived in computer vision, enabling unprecedented image processes. Yet the results in audio remain less advanced. Our project targets real-time sound synthe…