Attention Kernels for Learning Maps Between Heavy-Tailed Measures

Kailen Hargenrader, Edoardo Calvello, Bohan Chen

Operator learning on probability measures can be accomplished with transformers. For measures with polynomial tails, the exponential weighting in softmax can make the corresponding…