Friends and Grandmothers in Silico: Localizing Entity Cells in Language Models

Itay Yona, Dan Barzilay, Michael Karasik +1

How do language models retrieve entity-specific facts from their parameters? We investigate this question by searching for sparse, entity-selective MLP neurons - which we call enti…