9 citations · 9 across the 3 of their papers we have counts for
4 papers
Chain of Thought Monitoring Can Fail Even When CoT Is Necessary
Lennart Bürger, Piotr Komorowski, Moritz Weckbecker +4
Chain of Thought (CoT) monitoring is used by frontier labs to detect misbehaviour of AI systems. Yet, its reliability remains poorly understood. We attribute this to the lack of a…
Circuit Insights: Towards Interpretability Beyond Activations
Elena Golimblevskaia, Aakriti Jain, Bruno Puri +3
The fields of explainable AI and mechanistic interpretability aim to uncover the internal structure of neural networks, with circuit discovery as a central tool for understanding m…
FADE: Why Bad Descriptions Happen to Good Features
Bruno Puri, Aakriti Jain, Elena Golimblevskaia +4
Recent advances in mechanistic interpretability have highlighted the potential of automating interpretability pipelines in analyzing the latent representations within LLMs. While t…
AttnLRP: Attention-Aware Layer-Wise Relevance Propagation for Transformers
Reduan Achtibat, Sayed Mohammad Vakilzadeh Hatefi, Maximilian Dreyer +4
Large Language Models are prone to biased predictions and hallucinations, underlining the paramount importance of understanding their model-internal reasoning process. However, ach…