Showing cs.CLShow all
2 papers · 1 filter
cs.CL2025
Graph Laplacian Wavelet Transformer via Learnable Spectral Decomposition
Andrew Kiruluta, Eric Lundy, Priscilla Burity
Existing sequence to sequence models for structured language tasks rely heavily on the dot product self attention mechanism, which incurs quadratic complexity in both computation a…
cs.CL2025
Beyond Self Attention: A Subquadratic Fourier Wavelet Transformer with Multi Modal Fusion
Andrew Kiruluta, Andreas Lemos, Eric Lundy
We revisit the use of spectral techniques to replaces the attention mechanism in Transformers through Fourier Transform based token mixing, and present a comprehensive and novel re…