Concise One-Layer Transformers Can Perform Dictionary Lookup

Lena Strobl, Anton Hampe, Dana Angluin +1

While transformers have proven enormously successful in a range of tasks, their fundamental properties as models of computation are not well understood. This paper contributes to t…