Location-Aware Language Models via Secondary Embeddings

Gokul Srinivasagan, Munir Georges

Pretrained transformer-based language models achieve strong performance across a wide range of NLP tasks but remain limited in encoding geo-locational semantics, leading to subopti…