Multiscale Attention via Wavelet Neural Operators for Vision Transformers

Anahita Nekoozadeh, Mohammad Reza Ahmadzadeh, Zahra Mardani

Transformers have achieved widespread success in computer vision. At their heart, there is a Self-Attention (SA) mechanism, an inductive bias that associates each token in the inpu…