95 citations · 201 across the 14 of their papers we have counts for
Showing 2023Show all
2 papers · 1 filter
cs.AI2023★ 95 cited
Open Problems and Fundamental Limitations of Reinforcement Learning from Human Feedback
Stephen Casper, Xander Davies, Claudia Shi +29
Reinforcement learning from human feedback (RLHF) is a technique for training AI systems to align with human goals. RLHF has emerged as the central method used to finetune state-of…
cs.LG2023★ 8 cited
The Quantization Model of Neural Scaling
Eric J. Michaud, Ziming Liu, Uzay Girit +1
We propose the Quantization Model of neural scaling laws, explaining both the observed power law dropoff of loss with model and data size, and also the sudden emergence of new capa…