Transformers in Uniform TC${}^0$

David Chiang

Previous work has shown that the languages recognized by average-hard attention transformers (AHATs) and softmax-attention transformers (SMATs) are within the circuit complexity cl…