N2G: A Scalable Approach for Quantifying Interpretable Neuron Representations in Large Language Models

Alex Foote, Neel Nanda, Esben Kran +2

Understanding the function of individual neurons within language models is essential for mechanistic interpretability research. We propose $\text{Neuron to Graph (N2G)}$, a tool…