Training Transformers as a Universal Computer

Ruize Xu, Chenxiao Yang, Yanhong Li +1

We demonstrate that a small transformer can learn to execute programs in MicroPy, a simplified yet computationally universal programming language. Given procedure definitions toget…