Graph Laplacian Wavelet Transformer via Learnable Spectral Decomposition

Andrew Kiruluta, Eric Lundy, Priscilla Burity

Existing sequence to sequence models for structured language tasks rely heavily on the dot product self attention mechanism, which incurs quadratic complexity in both computation a…