4 papers
CORD-19: The COVID-19 Open Research Dataset
Lucy Lu Wang, Kyle Lo, Yoganand Chandrasekhar +25
The COVID-19 Open Research Dataset (CORD-19) is a growing resource of scientific papers on COVID-19 and related historical coronavirus research. CORD-19 is designed to facilitate t…
A Formal Hierarchy of RNN Architectures
William Merrill, Gail Weiss, Yoav Goldberg +3
We develop a formal hierarchy of the expressive capacity of RNN architectures. The hierarchy is based on two formal properties: space complexity, which measures the RNN's memory, a…
Detecting Syntactic Change Using a Neural Part-of-Speech Tagger
William Merrill, Gigi Felice Stark, Robert Frank
We train a diachronic long short-term memory (LSTM) part-of-speech tagger on a large corpus of American English from the 19th, 20th, and 21st centuries. We analyze the tagger's abi…
Finding Syntactic Representations in Neural Stacks
William Merrill, Lenny Khazan, Noah Amsel +3
Neural network architectures have been augmented with differentiable stacks in order to introduce a bias toward learning hierarchy-sensitive regularities. It has, however, proven d…