activity
20172022
most citedScaling Up Models and Data with and

48 citations · 154 across the 7 of their papers we have counts for

collaborators

17 papers

cs.CL2022★ 21 cited

Continuous diffusion for categorical data

Sander Dieleman, Laurent Sartran, Arman Roshannai +11

Diffusion models have quickly become the go-to paradigm for generative modelling of perceptual signals (such as images and sound) through iterative refinement. Their success hinges…

cs.SD2022★ 8 cited

The Chamber Ensemble Generator: Limitless High-Quality MIR Data via Generative Modeling

Yusong Wu, Josh Gardner, Ethan Manilow +3

Data is the lifeblood of modern machine learning systems, including for those in Music Information Retrieval (MIR). However, MIR has long been mired by small datasets and unreliabl…

cs.SD2022★ 15 cited

Multi-instrument Music Synthesis with Spectrogram Diffusion

Curtis Hawthorne, Ian Simon, Adam Roberts +4

An ideal music synthesizer should be both interactive and expressive, generating high-fidelity audio in realtime for arbitrary combinations of instruments and notes. Recent neural…

cs.LG2022★ 48 cited

Scaling Up Models and Data with and

Adam Roberts, Hyung Won Chung, Anselm Levskaya +40

Recent neural network-based language models have benefited greatly from scaling up the size of training datasets and the number of parameters in the models themselves. Scaling can…

cs.SD2022

Improving Source Separation by Explicitly Modeling Dependencies Between Sources

Ethan Manilow, Curtis Hawthorne, Cheng-Zhi Anna Huang +2

We propose a new method for training a supervised source separation system that aims to learn the interdependent relationships between all combinations of sources in a mixture. Rat…

cs.LG2022

General-purpose, long-context autoregressive modeling with Perceiver AR

Curtis Hawthorne, Andrew Jaegle, Cătălina Cangea +12

Real-world data is high-dimensional: a book, image, or musical performance can easily contain hundreds of thousands of elements even after compression. However, the most commonly u…