Programs-of-Layers in LLMs through the Lens of Cortical Areas

Justus Westerhoff, Stephan Olbrich, Hatem Oraby +2

Inference in LLMs is conventionally a fixed-depth, fixed-order forward pass through every layer, regardless of how difficult the input is. The human brain does not work this way: u…