Showing 2026Show all
2 papers · 1 filter
cs.LG2026
Approaching I/O-optimality for Approximate Attention
Pál András Papp, Aleksandros Sobczyk, Anastasios Zouzias
We revisit the I/O complexity of attention in large language models. Given query-key-value matrices , and a machine with fast memory size , the g…
cs.LG2026
Fast and Stable Triangular Inversion for Delta-Rule Linear Transformers
Aleksandros Sobczyk, Gioele Gottardo, Christos K. Matzoros +4
Linear attention has emerged as a cornerstone for efficient long-context architectures, as evidenced by its integration into state-of-the-art open-source models including Qwen3.5/3…