Positional Attention: Expressivity and Learnability of Algorithmic Computation

Artur Back de Luca, George Giapitzakis, Shenghao Yang +2

There is a growing interest in the ability of neural networks to execute algorithmic tasks (e.g., arithmetic, summary statistics, and sorting). The goal of this work is to better u…