3 papers
cs.CL2025
Graph Laplacian Wavelet Transformer via Learnable Spectral Decomposition
Andrew Kiruluta, Eric Lundy, Priscilla Burity
Existing sequence to sequence models for structured language tasks rely heavily on the dot product self attention mechanism, which incurs quadratic complexity in both computation a…
cs.LG2025
FourierNAT: A Fourier-Mixing-Based Non-Autoregressive Transformer for Parallel Sequence Generation
Andrew Kiruluta, Eric Lundy, Andreas Lemos
We present FourierNAT, a novel non-autoregressive Transformer (NAT) architecture that employs Fourier-based mixing in the decoder to generate output sequences in parallel. While tr…
cs.CV2024
Hierarchical Attention Diffusion Networks with Object Priors for Video Change Detection
Andrew Kiruluta, Eric Lundy, Andreas Lemos
We present a unified change detection pipeline that combines instance level masking, multi\-scale attention within a denoising diffusion model, and per pixel semantic classificatio…