Neuron-Level Differentiation of Memorization and Generalization in Large Language Models

Ko-Wei Huang, Yi-Fu Fu, Ching-Yu Tsai +8

We investigate how Large Language Models (LLMs) distinguish between memorization and generalization at the neuron level. Through carefully designed tasks, we identify distinct neur…