activity
20172026
most citedBeyond the Imitation Game: Quantifying and extrapolating the capabilities of language models

565 citations · 890 across the 47 of their papers we have counts for

collaborators
Showing 2020Show all

9 papers · 1 filter

cs.CL2020★ 1 cited

A Dataset for Tracking Entities in Open Domain Procedural Text

Niket Tandon, Keisuke Sakaguchi, Bhavana Dalvi Mishra +5

We present the first dataset for tracking state changes in procedural text from arbitrary domains by using an unrestricted (open) vocabulary. For example, in a text describing fog…

cs.CL2020★ 9 cited

OCNLI: Original Chinese Natural Language Inference

Hai Hu, Kyle Richardson, Liang Xu +3

Despite the tremendous recent progress on natural language inference (NLI), driven largely by large-scale investment in new datasets (e.g., SNLI, MNLI) and advances in modeling, mo…

cs.CL2020★ 4 cited

Temporal Reasoning on Implicit Events from Distant Supervision

Ben Zhou, Kyle Richardson, Qiang Ning +3

We propose TRACIE, a novel temporal reasoning dataset that evaluates the degree to which systems understand implicit events -- events that are not mentioned explicitly in natural l…

cs.CL2020★ 12 cited

Critical Thinking for Language Models

Gregor Betz, Christian Voigt, Kyle Richardson

This paper takes a first step towards a critical thinking curriculum for neural auto-regressive language models. We introduce a synthetic corpus of deductively valid arguments, and…

cs.CL2020

Text Modular Networks: Learning to Decompose Tasks in the Language of Existing Models

Tushar Khot, Daniel Khashabi, Kyle Richardson +2

We propose a general framework called Text Modular Networks(TMNs) for building interpretable systems that learn to solve complex tasks by decomposing them into simpler ones solvabl…

cs.CL2020★ 12 cited

Do Dogs have Whiskers? A New Knowledge Base of hasPart Relations

Sumithra Bhakthavatsalam, Kyle Richardson, Niket Tandon +1

We present a new knowledge-base of hasPart relationships, extracted from a large corpus of generic statements. Complementary to other resources available, it is the first which is…

cs.CL2020

Neural Natural Language Inference Models Partially Embed Theories of Lexical Entailment and Negation

Atticus Geiger, Kyle Richardson, Christopher Potts

We address whether neural models for Natural Language Inference (NLI) can learn the compositional interactions between lexical entailment and negation, using four methods: the beha…

cs.CL2020★ 62 cited

CLUE: A Chinese Language Understanding Evaluation Benchmark

Liang Xu, Hai Hu, Xuanwei Zhang +29

The advent of natural language understanding (NLU) benchmarks for English, such as GLUE and SuperGLUE allows new NLU models to be evaluated across a diverse set of tasks. These com…

cs.CL2020

Transformers as Soft Reasoners over Language

Peter Clark, Oyvind Tafjord, Kyle Richardson

Beginning with McCarthy's Advice Taker (1959), AI has pursued the goal of providing a system with explicit, general knowledge and having the system reason over that knowledge. Howe…