Post-Boundary Bridge: Must Local Attention Go Global Between Global Layers?

Zhibo Yang

Hybrid Transformers reduce the cost of long-context modeling by combining local attention with periodic full-attention layers. When global communication is already available, howev…