activity
20142026
most citedBeyond the Imitation Game: Quantifying and extrapolating the capabilities of language models

565 citations · 889 across the 33 of their papers we have counts for

collaborators
Showing 2022Show all

11 papers · 1 filter

cs.CL2022

PropSegmEnt: A Large-Scale Corpus for Proposition-Level Segmentation and Entailment Recognition

Sihao Chen, Senaka Buthpitiya, Alex Fabrikant +2

The widely studied task of Natural Language Inference (NLI) requires a system to recognize whether one piece of text is textually entailed by another, i.e. whether the entirety of…

cs.CL2022★ 27 cited

Attributed Question Answering: Evaluation and Modeling for Attributed Large Language Models

Bernd Bohnet, Vinh Q. Tran, Pat Verga +19

Large language models (LLMs) have shown impressive results while requiring little or no direct supervision. Further, there is mounting evidence that LLMs may have potential in info…

cs.LG2022★ 4 cited

Is margin all you need? An extensive empirical study of active learning on tabular data

Dara Bahri, Heinrich Jiang, Tal Schuster +1

Given a labeled training set and a collection of unlabeled data, the goal of active learning (AL) is to identify the best unlabeled points to label. In this comprehensive study, we…

stat.ME2022★ 25 cited

Conformal Risk Control

Anastasios N. Angelopoulos, Stephen Bates, Adam Fisch +2

We extend conformal prediction to control the expected value of any monotone loss function. The algorithm generalizes split conformal prediction together with its coverage guarante…

cs.CL2022★ 40 cited

Confident Adaptive Language Modeling

Tal Schuster, Adam Fisch, Jai Gupta +5

Recent advances in Transformer-based large language models (LLMs) have led to significant performance improvements across many tasks. These gains come with a drastic increase in th…

cs.CL2022★ 565 cited

Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models

Aarohi Srivastava, Abhinav Rastogi, Abhishek Rao +448

Language models demonstrate both quantitative improvement and new qualitative capabilities with increasing scale. Despite their potentially transformative impact, these new capabil…