Multi-component Causal Tracing in Large Language Models

Zirui Yan, Dennis Wei, Dmitriy A. Katz +2

Causal tracing systematically intervenes on a large language model's (LLM's) internal representations to uncover and quantify the causal pathways linking specific inputs or computa…