From the 1 of 3 linked papers with an AI index.
3 papers
cs.CL2026
A Shared Subcircuit Lets LLMs Count Down Across Tasks
Jacob Dunefsky, Wes Gurnee, Emmanuel Ameisen
The paper identifies a "countdown subcircuit" in Llama-3.1-70B-Instruct that compares the current token position to a target length, enabling the model to track remaining tokens fo…
cs.LG2025
One-shot Optimized Steering Vectors Mediate Safety-relevant Behaviors in LLMs
Jacob Dunefsky, Arman Cohan
Steering vectors (SVs) have emerged as a promising approach for interpreting and controlling LLMs, but current methods typically require large contrastive datasets that are often i…
cs.LG2024
Transcoders Find Interpretable LLM Feature Circuits
Jacob Dunefsky, Philippe Chlenski, Neel Nanda
A key goal in mechanistic interpretability is circuit analysis: finding sparse subgraphs of models corresponding to specific behaviors or capabilities. However, MLP sublayers make…