MACRO: Markov Chain Routing of Transformer Layers

Paweł Batorski, Abtin Pourhadi, Akylgali Aitaza +2

Standard Large Language Models (LLMs) execute layers sequentially. Dynamic layer routing, i.e. search for a different execution path through layers involving layer repetitions, ski…