Scientific and Creative Analogies in Pretrained Language Models

Tamara Czinczoll, Helen Yannakoudakis, Pushkar Mishra +1

This paper examines the encoding of analogy in large-scale pretrained language models, such as BERT and GPT-2. Existing analogy datasets typically focus on a limited set of analogi…