activity
20112026
most citedBeyond the Imitation Game: Quantifying and extrapolating the capabilities of language models

565 citations · 2.3k across the 68 of their papers we have counts for

collaborators
Showing 2019Show all

11 papers · 1 filter

cs.CL2019

What Does My QA Model Know? Devising Controlled Probes using Expert Knowledge

Kyle Richardson, Ashish Sabharwal

Open-domain question answering (QA) is known to involve several underlying knowledge and reasoning challenges, but are models actually learning such knowledge when trained on bench…

cs.LG2019★ 5 cited

Approximating the Permanent by Sampling from Adaptive Partitions

Jonathan Kuck, Tri Dao, Hamid Rezatofighi +2

Computing the permanent of a non-negative matrix is a core problem with practical applications ranging from target tracking to statistical thermodynamics. However, this problem is…

cs.CL2019★ 2 cited

Not All Claims are Created Equal: Choosing the Right Statistical Approach to Assess Hypotheses

Erfan Sadeqi Azer, Daniel Khashabi, Ashish Sabharwal +1

Empirical research in Natural Language Processing (NLP) has adopted a narrow set of principles for assessing hypotheses, relying mainly on p-value computation, which suffers from s…

cs.CL2019

QASC: A Dataset for Question Answering via Sentence Composition

Tushar Khot, Peter Clark, Michal Guerquin +2

Composing knowledge from multiple pieces of texts is a key challenge in multi-hop question answering. We present a multi-hop reasoning dataset, Question Answering via Sentence Comp…

cs.LG2019★ 1 cited

Towards Efficient Discrete Integration via Adaptive Quantile Queries

Fan Ding, Hanjing Wang, Ashish Sabharwal +1

Discrete integration in a high dimensional space of n variables poses fundamental challenges. The WISH algorithm reduces the intractable discrete integration problem into n optimiz…

cs.CL2019★ 1 cited

What's Missing: A Knowledge Gap Guided Approach for Multi-hop Question Answering

Tushar Khot, Ashish Sabharwal, Peter Clark

Multi-hop textual question answering requires combining information from multiple sentences. We focus on a natural setting where, unlike typical reading comprehension, only partial…