Transformers are Efficient Compilers, Provably

Xiyu Zhai, Runlong Zhou, Liao Zhang +1

Transformer-based large language models (LLMs) have demonstrated surprisingly robust performance across a wide range of language-related tasks, including programming language under…