Explicitly Representing Syntax Improves Sentence-to-layout Prediction of Unexpected Situations

Wolf Nuyts, Ruben Cartuyvels, Marie-Francine Moens

Recognizing visual entities in a natural language sentence and arranging them in a 2D spatial layout require a compositional understanding of language and space. This task of layou…