Tracing Facts or just Copies? A critical investigation of the Competitions of Mechanisms in Large Language Models

Dante Campregher, Yanxu Chen, Sander Hoffman +1

This paper presents a reproducibility study examining how Large Language Models (LLMs) manage competing factual and counterfactual information, focusing on the role of attention he…