FTB Graph: Determining and Validating First-token Broadcasters and Language-Identity Head Circuits in Multilingual Language Models

Arjun Pillai, Christian Hoang, Anjelo Laroza

Large language models operating in multilingual contexts must resolve target response languages early in generation, yet the causal circuitry governing first-token language identit…