5.3k citations · 13.3k across the 19 of their papers we have counts for
4 papers · 1 filter
Scaling Laws for Autoregressive Generative Modeling
Tom Henighan, Jared Kaplan, Mor Katz +16
We identify empirical scaling laws for the cross-entropy loss in four domains: generative image modeling, video modeling, multimodal imagetext models, and mathemat…
Recurrent Neural-Linear Posterior Sampling for Nonstationary Contextual Bandits
Aditya Ramesh, Paulo Rauber, Michelangelo Conserva +1
An agent in a nonstationary contextual bandit problem should balance between exploration and the exploitation of (periodic or structured) patterns present in its previous experienc…
CompressNet: Generative Compression at Extremely Low Bitrates
Suraj Kiran Raman, Aditya Ramesh, Vijayakrishna Naganoor +3
Compressing images at extremely low bitrates (< 0.1 bpp) has always been a challenging task since the quality of reconstruction significantly reduces due to the strong imposed cons…
Language Models are Few-Shot Learners
Tom B. Brown, Benjamin Mann, Nick Ryder +28
Recent work has demonstrated substantial gains on many NLP tasks and benchmarks by pre-training on a large corpus of text followed by fine-tuning on a specific task. While typicall…