281 citations · 483 across the 6 of their papers we have counts for
6 papers
Language Model Cascades
David Dohan, Winnie Xu, Aitor Lewkowycz +9
Prompted models have demonstrated impressive few-shot learning abilities. Repeated interactions at test-time with a single model, or the composition of multiple models together, fu…
Exploring Length Generalization in Large Language Models
Cem Anil, Yuhuai Wu, Anders Andreassen +7
The ability to extrapolate from short problem instances to longer ones is an important form of out-of-distribution generalization in reasoning tasks, and is crucial when learning f…
Solving Quantitative Reasoning Problems with Language Models
Aitor Lewkowycz, Anders Andreassen, David Dohan +11
Language models have achieved remarkable performance on a wide range of tasks that require natural language understanding. Nevertheless, state-of-the-art models have generally stru…
A CFT Perspective on Gravitational Dressing and Bulk Locality
Aitor Lewkowycz, Gustavo J. Turiaci, Herman Verlinde
We revisit the construction of local bulk operators in AdS/CFT with special focus on gravitational dressing and its consequences for bulk locality. Specializing to 2+1-dimensions,…
Renyi entropy, stationarity, and entanglement of the conformal scalar
Jeongseog Lee, Aitor Lewkowycz, Eric Perlmutter +1
We extend previous work on the perturbative expansion of the Renyi entropy, , around for a spherical entangling surface in a general CFT. Applied to conformal scalar fie…
Holographic Entanglement Entropy and Confinement
Aitor Lewkowycz
We study the phase transition in the holographic entanglement entropy for various confining models. This transition occurs for the entanglement entropy of a strip at a critical val…