Where does an LLM begin computing an instruction?

Aditya Pola, Vineeth N. Balasubramanian

Following an instruction involves distinct sub-processes, such as reading content, reading the instruction, executing it, and producing an answer. We ask where, along the layer sta…