RNNs Implicitly Implement Tensor Product Representations

R. Thomas McCoy, Tal Linzen, Ewan Dunbar +1

Recurrent neural networks (RNNs) can learn continuous vector representations of symbolic structures such as sequences and sentences; these representations often exhibit linear regu…