Efficient numeracy in language models through single-token number embeddings

Linus Kreitner, Paul Hager, Jonathan Mengedoht +3

To drive progress in science and engineering, large language models (LLMs) must be able to process large amounts of numerical data and solve long calculations efficiently. This is…