What do Models Learn From Training on More Than Text? Measuring Visual Commonsense Knowledge

Lovisa Hagström, Richard Johansson

There are limitations in learning language from text alone. Therefore, recent focus has been on developing multimodal models. However, few benchmarks exist that can measure what la…