Native Multi-Dimensional Subquadratic Operators via Input Dependent Long Convolutions

David R. Wessels, Farhad Ramezanghorbani, David W. Romero +9

Subquadratic alternatives to attention require compromises when applied to multi-dimensional data: standard convolutions lack global receptive fields and input dependency, while re…