Relational Weight Priors in Neural Networks for Abstract Pattern Learning and Language Modelling

Radha Kopparti, Tillman Weyde

Deep neural networks have become the dominant approach in natural language processing (NLP). However, in recent years, it has become apparent that there are shortcomings in systema…