How Can Self-Attention Networks Recognize Dyck-n Languages?

Javid Ebrahimi, Dhruv Gelda, Wei Zhang

We focus on the recognition of Dyck-n (${\mathcal{D}}_n$) languages with self-attention (SA) networks, which has been deemed to be a difficult task for these networks. We compare the…