Publications (31)
Multi-instrument Music Synthesis with Spectrogram Diffusion
Curtis Hawthorne, Ian Simon, Adam Roberts +4
Symbolic Music Generation with Diffusion Models
Gautam Mittal, Jesse Engel, Curtis Hawthorne +1
HEAR: Holistic Evaluation of Audio Representations
Joseph Turian, Jordie Shier, Humair Raj Khan +20
Encoding Musical Style with Transformer Autoencoders
Kristy Choi, Curtis Hawthorne, Ian Simon +2
Redefining Relationships in Music
Christian Detweiler, Beth Coleman, Fernando Diaz +13
Variable-rate discrete representation learning
Sander Dieleman, Charlie Nash, Jesse Engel +1
MT3: Multi-Task Multitrack Music Transcription
Josh Gardner, Ian Simon, Ethan Manilow +2
Improving Source Separation by Explicitly Modeling Dependencies Between Sources
Ethan Manilow, Curtis Hawthorne, Cheng-Zhi Anna Huang +2
MusicLM: Generating Music From Text
Andrea Agostinelli, Timo I. Denk, Zalán Borsos +10
Enabling Factorized Piano Music Modeling and Generation with the MAESTRO Dataset
Curtis Hawthorne, Andriy Stasyuk, Adam Roberts +6
Sequence-to-Sequence Piano Transcription with Transformers
Curtis Hawthorne, Ian Simon, Rigel Swavely +2
Improving Perceptual Quality of Drum Transcription with the Expanded Groove MIDI Dataset
Lee Callender, Curtis Hawthorne, Jesse Engel
Learning a Latent Space of Multitrack Measures
Ian Simon, Adam Roberts, Colin Raffel +3
Learning to Groove with Inverse Sequence Transformations
Jon Gillick, Adam Roberts, Jesse Engel +2
Latent Translation: Crossing Modalities by Bridging Generative Models
Yingtao Tian, Jesse Engel
Live Music Models
Lyria Team, Antoine Caillon, Brian McWilliams +33
SingSong: Generating musical accompaniments from singing
Chris Donahue, Antoine Caillon, Adam Roberts +8
MIDI-DDSP: Detailed Control of Musical Performance via Hierarchical Modeling
Yusong Wu, Ethan Manilow, Yi Deng +6
The Chamber Ensemble Generator: Limitless High-Quality MIR Data via Generative Modeling
Yusong Wu, Josh Gardner, Ethan Manilow +3
Deep Speech 2: End-to-End Speech Recognition in English and Mandarin
Dario Amodei, Rishita Anubhai, Eric Battenberg +31
A Hierarchical Latent Vector Model for Learning Long-Term Structure in Music
Adam Roberts, Jesse Engel, Colin Raffel +2
Latent Constraints: Learning to Generate Conditionally from Unconditional Generative Models
Jesse Engel, Matthew Hoffman, Adam Roberts
DDSP: Differentiable Digital Signal Processing
Jesse Engel, Lamtharn Hantrakul, Chenjie Gu +1
Expressive Communication: A Common Framework for Evaluating Developments in Generative Models and Steering Interfaces
Ryan Louie, Jesse Engel, Anna Huang
Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models
Aarohi Srivastava, Abhinav Rastogi, Abhishek Rao +448
Neural Audio Synthesis of Musical Notes with WaveNet Autoencoders
Jesse Engel, Cinjon Resnick, Adam Roberts +4
Noise2Music: Text-conditioned Music Generation with Diffusion Models
Qingqing Huang, Daniel S. Park, Tao Wang +12
Learning via social awareness: Improving a deep generative sketching model with facial feedback
Natasha Jaques, Jennifer McCleary, Jesse Engel +4
General-purpose, long-context autoregressive modeling with Perceiver AR
Curtis Hawthorne, Andrew Jaegle, CÄtÄlina Cangea +12
Onsets and Frames: Dual-Objective Piano Transcription
Curtis Hawthorne, Erich Elsen, Jialin Song +6
GANSynth: Adversarial Neural Audio Synthesis
Jesse Engel, Kumar Krishna Agrawal, Shuo Chen +3