FiLM-Coordinated Dual-Branch Transformer for Global-Local Dependency Modeling in Language Modeling

Zhiqiang Zhou, Xu Ling, Junliang Dai

Standard Transformers use a single self-attention pathway to model both global dependencies and local patterns, creating tension between long-range structural reasoning and fine-gr…