1 citations · 1 across the 6 of their papers we have counts for
Showing cs.LGShow all
3 papers · 1 filter
cs.LG2025
Where to Add PDE Diffusion in Transformers
Yukun Zhang, Xueqing Zhou
Transformers enable powerful content-based global routing via self-attention, but they lack an explicit local geometric prior along the sequence axis. As a result, the placement of…
cs.LG2025
Continuous-Time Attention: PDE-Guided Mechanisms for Long-Sequence Transformers
Yukun Zhang, Xueqing Zhou
We propose a novel framework, Continuous_Time Attention, which infuses partial differential equations (PDEs) into the Transformer's attention mechanism to address the challenges of…
cs.LG2024★ 1 cited
Understanding Transformer Architecture through Continuous Dynamics: A Partial Differential Equation Perspective
Yukun Zhang, Xueqing Zhou
The Transformer architecture has revolutionized artificial intelligence, yet a principled theoretical understanding of its internal mechanisms remains elusive. This paper introduce…