Do Language Models Know the Way to Rome?

Bastien Liétard, Mostafa Abdou, Anders Søgaard

The global geometry of language models is important for a range of applications, but language model probes tend to evaluate rather local relations, for which ground truths are easi…