ITNet: A Learnable Integral Transform That Subsumes Convolution, Attention, and Recurrence

Ashim Dhor, Rasel Mondal, Pin-Yu Chen

Convolutional networks, recurrent networks, and transformers each encode different inductive biases -- locality, sequential memory, and content-dependent pairwise interaction -- an…