1.1k citations · 2.1k across the 19 of their papers we have counts for
3 papers · 1 filter
General Preference Reinforcement Learning
Muhammad Umer, Muhammad Ahmed Mohsin, Ahsan Bilal +5
Post-training has split large language model (LLM) alignment into two largely disconnected tracks. Online reinforcement learning (RL) with verifiable rewards drives emergent reason…
Improving Latent Generalization Using Test-time Compute
Arslan Chaudhry, Sridhar Thiagarajan, Andrew Lampinen
Language Models (LMs) exhibit two distinct mechanisms for knowledge acquisition: in-weights learning (i.e., encoding information within the model weights) and in-context learning (…
The Illusion of Latent Generalization: Bi-directionality and the Reversal Curse
Julian Coda-Forno, Jane X. Wang, Arslan Chaudhry
The reversal curse describes a failure of autoregressive language models to retrieve a fact in reverse order (e.g., training on ``'' but failing on ``''). Recent work…