Long-Context Modeling via GSS-Transformer Hybrid Architecture with Learnable Mixing

Kuzey Torlak, Hüseyin Arda Arslan, Anıl Dervişoğlu +2

Modeling long-range dependencies remains a central challenge in natural language processing. Transformer architectures achieve strong performance via self-attention but scale quadr…