Does Traversal Order Matter? A Systematic Study of Tree Traversal Methods in Transformer Grammars

Zongru Liu, Pengyu Ji, Pengcheng Wang +1

Transformer Grammars (TGs) enhance language modeling by incorporating syntactic tree structures. Despite the potentially significant impact on model performance of how syntactic tr…