16 citations · 38 across the 11 of their papers we have counts for
4 papers · 2 filters
Detecting Syntactic Change Using a Neural Part-of-Speech Tagger
William Merrill, Gigi Felice Stark, Robert Frank
We train a diachronic long short-term memory (LSTM) part-of-speech tagger on a large corpus of American English from the 19th, 20th, and 21st centuries. We analyze the tagger's abi…
Open Sesame: Getting Inside BERT's Linguistic Knowledge
Yongjie Lin, Yi Chern Tan, Robert Frank
How and to what extent does BERT encode syntactically-sensitive hierarchical information or positionally-sensitive linear information? Recent work has shown that contextual represe…
Finding Syntactic Representations in Neural Stacks
William Merrill, Lenny Khazan, Noah Amsel +3
Neural network architectures have been augmented with differentiable stacks in order to introduce a bias toward learning hierarchy-sensitive regularities. It has, however, proven d…
Syntax-aware Neural Semantic Role Labeling with Supertags
Jungo Kasai, Dan Friedman, Robert Frank +2
We introduce a new syntax-aware model for dependency-based semantic role labeling that outperforms syntax-agnostic models for English and Spanish. We use a BiLSTM to tag the text w…