Cell-Based Representation of Relational Binding in Language Models

Qin Dai, Benjamin Heinzerling, Kentaro Inui

Understanding a discourse requires tracking entities and the relations that hold between them. While Large Language Models (LLMs) perform well on relational reasoning, the mechanis…