On Learning the Transformer Kernel

Sankalan Pal Chowdhury, Adamos Solomou, Avinava Dubey +1

In this work we introduce KERNELIZED TRANSFORMER, a generic, scalable, data driven framework for learning the kernel function in Transformers. Our framework approximates the Transf…