Heads-up! Unsupervised Constituency Parsing via Self-Attention Heads

Bowen Li, Taeuk Kim, Reinald Kim Amplayo +1

Transformer-based pre-trained language models (PLMs) have dramatically improved the state of the art in NLP across many tasks. This has led to substantial interest in analyzing the…