2 papers
cs.CL2023
The Effect of Scaling, Retrieval Augmentation and Form on the Factual Consistency of Language Models
Lovisa Hagström, Denitsa Saynova, Tobias Norlund +2
Large Language Models (LLMs) make natural interfaces to factual knowledge, but their usefulness is limited by their tendency to deliver inconsistent answers to semantically equival…
cs.CL2023
On the Generalization Ability of Retrieval-Enhanced Transformers
Tobias Norlund, Ehsan Doostmohammadi, Richard Johansson +1
Recent work on the Retrieval-Enhanced Transformer (RETRO) model has shown that off-loading memory from trainable weights to a retrieval database can significantly improve language…