13 citations · 15 across the 8 of their papers we have counts for
8 papers
Surface-Based Retrieval Reduces Perplexity of Retrieval-Augmented Language Models
Ehsan Doostmohammadi, Tobias Norlund, Marco Kuhlmann +1
Augmenting language models with a retrieval mechanism has been shown to significantly improve their performance while keeping the number of parameters low. Retrieval-augmented mode…
An Empirical Study of Multitask Learning to Improve Open Domain Dialogue Systems
Mehrdad Farahani, Richard Johansson
Autoregressive models used to generate responses in open-domain dialogue systems often struggle to take long-term context into account and to maintain consistency over a dialogue.…
On the Generalization Ability of Retrieval-Enhanced Transformers
Tobias Norlund, Ehsan Doostmohammadi, Richard Johansson +1
Recent work on the Retrieval-Enhanced Transformer (RETRO) model has shown that off-loading memory from trainable weights to a retrieval database can significantly improve language…
Controlling for Stereotypes in Multimodal Language Model Evaluation
Manuj Malik, Richard Johansson
We propose a methodology and design two benchmark sets for measuring to what extent language-and-vision language models use the visual signal in the presence or absence of stereoty…
How to Adapt Pre-trained Vision-and-Language Models to a Text-only Input?
Lovisa Hagström, Richard Johansson
Current language models have been criticised for learning language from text alone without connection between words and their meaning. Consequently, multimodal training has been pr…
What do Models Learn From Training on More Than Text? Measuring Visual Commonsense Knowledge
Lovisa Hagström, Richard Johansson
There are limitations in learning language from text alone. Therefore, recent focus has been on developing multimodal models. However, few benchmarks exist that can measure what la…
Transferring Knowledge from Vision to Language: How to Achieve it and how to Measure it?
Tobias Norlund, Lovisa Hagström, Richard Johansson
Large language models are known to suffer from the hallucination problem in that they are prone to output statements that are false or inconsistent, indicating a lack of knowledge.…
A Simple and Efficient Method To Generate Word Sense Representations
Luis Nieto Piña, Richard Johansson
Distributed representations of words have boosted the performance of many Natural Language Processing tasks. However, usually only one representation per word is obtained, not ackn…