2 papers
cs.AI2026
FTB Graph: Determining and Validating First-token Broadcasters and Language-Identity Head Circuits in Multilingual Language Models
Arjun Pillai, Christian Hoang, Anjelo Laroza
Large language models operating in multilingual contexts must resolve target response languages early in generation, yet the causal circuitry governing first-token language identit…
cs.CL2026
First-Token Broadcasters: Mechanistic Origins of Language Identity and Distributed Robustness in Transformers
Arjun Pillai, Christian Hoang, Anjelo Jann Laroza
Why do multilingual language models sometimes generate in the wrong language, and why is this so hard to fix? We introduce Language Identity Head Ablation (LIHA), a causal interven…