When Language Models Fall in Love: Animacy Processing in Transformer Language Models

Michael Hanna, Yonatan Belinkov, Sandro Pezzelle

Animacy - whether an entity is alive and sentient - is fundamental to cognitive processing, impacting areas such as memory, vision, and language. However, animacy is not always exp…