Synthesis and Verification of Transformer Programs (Technical Report)

Hongjian Jiang, Matthew Hague, Philipp Rümmer +1

C-RASP is a simple programming language that was recently shown to capture concepts expressible by transformers. In this paper, we develop new algorithmic techniques for automatica…