Focused Contrastive Training for Test-based Constituency Analysis

Benjamin Roth, Erion Çano

We propose a scheme for self-training of grammaticality models for constituency analysis based on linguistic tests. A pre-trained language model is fine-tuned by contrastive estima…