Representational Analysis of Binding in Language Models

Qin Dai, Benjamin Heinzerling, Kentaro Inui

Entity tracking is essential for complex reasoning. To perform in-context entity tracking, language models (LMs) must bind an entity to its attribute (e.g., bind a container to its…