2.7k citations · 3k across the 5 of their papers we have counts for
5 papers
Llama 2: Open Foundation and Fine-Tuned Chat Models
Hugo Touvron, Louis Martin, Kevin Stone +65
In this work, we develop and release Llama 2, a collection of pretrained and fine-tuned large language models (LLMs) ranging in scale from 7 billion to 70 billion parameters. Our f…
A Theory on Adam Instability in Large-Scale Machine Learning
Igor Molybog, Peter Albert, Moya Chen +14
We present a theory for the previously unexplained divergent behavior noticed in the training of large language models. We argue that the phenomenon is an artifact of the dominant…
Galactica: A Large Language Model for Science
Ross Taylor, Marcin Kardas, Guillem Cucurull +6
Information overload is a major obstacle to scientific progress. The explosive growth in scientific literature and data has made it ever harder to discover useful insights in a lar…
Almost split sequences for Knorr lattices
Andrew Poulton
Let be a complete d.v.r. and a finite group. We give two applications of an adjunction in the stable category of . The first application gives necessary and sufficient…
Maps admitting trialities but not dualities
Gareth A. Jones, Andrew Poulton
We use group theory to construct infinite families of maps on surfaces which are invariant under Wilson's map operations of order 3 but not under the operations of order 2, such as…