HAARES Half-Split Residual Basis Routing for Deep Transformers

Kehan Wang

Block-level residual routing makes learned residual aggregation practical by routing over block summaries, but each summary compresses an ordered sequence of attention and MLP upda…