Capability Provenance in Language Models: A Case Study in Social Reasoning

Glenn Matlin, Chandreyi Chakraborty, Saehee Eom +8

We use training-data attribution as an interpretable tool for capability discovery, mapping which regions of the pretraining corpus support social-reasoning versus STEM-reasoning i…