Limits of Deep Learning: Sequence Modeling through the Lens of Complexity Theory

Nikola Zubić, Federico Soldá, Aurelio Sulser +1

Despite their successes, deep learning models struggle with tasks requiring complex reasoning and function composition. We present a theoretical and empirical investigation into th…