Flash Interpretability: Decoding Specialised Feature Neurons in Large Language Models with the LM-Head

Harry J Davies

Large Language Models (LLMs) typically have billions of parameters and are thus often difficult to interpret in their operation. In this work, we demonstrate that it is possible to…