526 citations · 1.2k across the 33 of their papers we have counts for
21 papers · 1 filter
Social Bias Frames: Reasoning about Social and Power Implications of Language
Maarten Sap, Saadia Gabriel, Lianhui Qin +3
Warning: this paper contains content that may be offensive or upsetting. Language has the power to reinforce stereotypes and project social biases onto others. At the core of the c…
Improving Transformer Models by Reordering their Sublayers
Ofir Press, Noah A. Smith, Omer Levy
Multilayer transformer networks consist of interleaved self-attention and feedforward sublayers. Could ordering the sublayers in a different pattern lead to better performance? We…
Knowledge Enhanced Contextual Word Representations
Matthew E. Peters, Mark Neumann, Robert L. Logan +4
Contextual word representations, typically trained on unstructured, unlabeled text, do not contain any explicit grounding to real world entities and are often unable to remember fa…
Situating Sentence Embedders with Nearest Neighbor Overlap
Lucy H. Lin, Noah A. Smith
As distributed approaches to natural language semantics have developed and diversified, embedders for linguistic units larger than words have come to play an increasingly important…
Low-Resource Parsing with Crosslingual Contextualized Representations
Phoebe Mulcaire, Jungo Kasai, Noah A. Smith
Despite advances in dependency parsing, languages with small treebanks still present challenges. We assess recent approaches to multilingual contextual word representations (CWRs),…
Improving Natural Language Inference with a Pretrained Parser
Deric Pang, Lucy H. Lin, Noah A. Smith
We introduce a novel approach to incorporate syntax into natural language inference (NLI) models. Our method uses contextual token-level vector representations from a pretrained de…