1.1k citations · 2.1k across the 19 of their papers we have counts for
3 papers · 1 filter
The Illusion of Latent Generalization: Bi-directionality and the Reversal Curse
Julian Coda-Forno, Jane X. Wang, Arslan Chaudhry
The reversal curse describes a failure of autoregressive language models to retrieve a fact in reverse order (e.g., training on ``'' but failing on ``''). Recent work…
On the generalization of language models from in-context learning and finetuning: a controlled study
Andrew K. Lampinen, Arslan Chaudhry, Stephanie C. Y. Chan +7
Large language models exhibit exciting capabilities, yet can show surprisingly narrow generalization from finetuning. E.g. they can fail to generalize to simple reversals of relati…
Finetuning Language Models to Emit Linguistic Expressions of Uncertainty
Arslan Chaudhry, Sridhar Thiagarajan, Dilan Gorur
Large language models (LLMs) are increasingly employed in information-seeking and decision-making tasks. Despite their broad utility, LLMs tend to generate information that conflic…