Neuron Empirical Gradient: Discovering and Quantifying Neurons Global Linear Controllability

Xin Zhao, Zehui Jiang, Naoki Yoshinaga

While feed-forward neurons in pre-trained language models (PLMs) can encode knowledge, past research targeted a small subset of neurons that heavily influence outputs. This leaves…