2 papers
cs.AI2025
Distributed Specialization: Rare-Token Neurons in Large Language Models
Jing Liu, Haozheng Wang, Yueheng Li
Large language models (LLMs) struggle with representing and generating rare tokens despite their importance in specialized domains. We investigate whether LLMs develop internal spe…
cs.AI2025
Emergent Specialization: Rare Token Neurons in Language Models
Jing Liu, Haozheng Wang, Yueheng Li
Large language models struggle with representing and generating rare tokens despite their importance in specialized domains. In this study, we identify neuron structures with excep…