2.2k citations · 5.1k across the 21 of their papers we have counts for
3 papers · 1 filter
Language Modeling at Scale
Mostofa Patwary, Milind Chabbi, Heewoo Jun +3
We show how Zipf's Law can be used to scale up language modeling (LM) to take advantage of more training data and more GPUs. LM plays a key role in many important natural language…
Fast Spectrogram Inversion using Multi-head Convolutional Neural Networks
Sercan O. Arik, Heewoo Jun, Gregory Diamos
We propose the multi-head convolutional neural network (MCNN) architecture for waveform synthesis from spectrograms. Nonlinear interpolation in MCNN is employed with transposed con…
Resource-Efficient Neural Architect
Yanqi Zhou, Siavash Ebrahimi, Sercan Ö. Arık +3
Neural Architecture Search (NAS) is a laborious process. Prior work on automated NAS targets mainly on improving accuracy, but lacks consideration of computational resource use. We…