Discovering the Compositional Structure of Vector Representations with Role Learning Networks

Paul Soulos, Tom McCoy, Tal Linzen +1

How can neural networks perform so well on compositional tasks even though they lack explicit compositional representations? We use a novel analysis technique called ROLE to show t…