Subregular Complexity and Deep Learning

Enes Avcu, Chihiro Shibata, Jeffrey Heinz

This paper argues that the judicial use of formal language theory and grammatical inference are invaluable tools in understanding how deep neural networks can and cannot represent…