673 citations · 1k across the 10 of their papers we have counts for
12 papers
Understanding Shared Speech-Text Representations
Gary Wang, Kyle Kastner, Ankur Bapna +4
Recently, a number of approaches to train speech models by incorpo-rating text into end-to-end models have been developed, with Mae-stro advancing state-of-the-art automatic speech…
R-MelNet: Reduced Mel-Spectral Modeling for Neural TTS
Kyle Kastner, Aaron Courville
This paper introduces R-MelNet, a two-part autoregressive architecture with a frontend based on the first tier of MelNet and a backend WaveRNN-style audio decoder for neural text-t…
MIDI-DDSP: Detailed Control of Musical Performance via Hierarchical Modeling
Yusong Wu, Ethan Manilow, Yi Deng +6
Musical expression requires control of both what notes are played, and how they are performed. Conventional audio synthesizers provide detailed expressive controls, but at the cost…
Planning in Dynamic Environments with Conditional Autoregressive Models
Johanna Hansen, Kyle Kastner, Aaron Courville +1
We demonstrate the use of conditional autoregressive generative models (van den Oord et al., 2016a) over a discrete latent space (van den Oord et al., 2017b) for forward planning w…
Representation Mixing for TTS Synthesis
Kyle Kastner, João Felipe Santos, Yoshua Bengio +1
Recent character and phoneme-based parametric TTS systems using deep learning have shown strong performance in natural speech generation. However, the choice between character or p…
Harmonic Recomposition using Conditional Autoregressive Modeling
Kyle Kastner, Rithesh Kumar, Tim Cooijmans +1
We demonstrate a conditional autoregressive pipeline for efficient music recomposition, based on methods presented in van den Oord et al.(2017). Recomposition (Casal & Casey, 2010)…