activity
20162023
most citedBeyond the Imitation Game: Quantifying and extrapolating the capabilities of language models

565 citations · 913 across the 23 of their papers we have counts for

collaborators

24 papers

cs.CL2023★ 1 cited

BM25 Query Augmentation Learned End-to-End

Xiaoyin Chen, Sam Wiseman

Given BM25's enduring competitiveness as an information retrieval baseline, we investigate to what extent it can be even further improved by augmenting and re-weighting its sparse…

cs.CL2023

Approximating CKY with Transformers

Ghazal Khalighinejad, Ollie Liu, Sam Wiseman

We investigate the ability of transformer models to approximate the CKY algorithm, using them to directly predict a sentence's parse and thus avoid the CKY algorithm's cubic depend…

cs.CL2022★ 565 cited

Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models

Aarohi Srivastava, Abhinav Rastogi, Abhishek Rao +448

Language models demonstrate both quantitative improvement and new qualitative capabilities with increasing scale. Despite their potentially transformative impact, these new capabil…

cs.CL2021

On Generalization in Coreference Resolution

Shubham Toshniwal, Patrick Xia, Sam Wiseman +2

While coreference resolution is defined independently of dataset domain, most models for performing coreference resolution do not transfer well to unseen domains. We consolidate a…

cs.CL2021

Chess as a Testbed for Language Model State Tracking

Shubham Toshniwal, Sam Wiseman, Karen Livescu +1

Transformer language models have made tremendous strides in natural language understanding tasks. However, the complexity of natural language makes it challenging to ascertain how…

cs.CL2021

Data-to-text Generation by Splicing Together Nearest Neighbors

Sam Wiseman, Arturs Backurs, Karl Stratos

We propose to tackle data-to-text generation tasks by directly splicing together retrieved segments of text from "neighbor" source-target pairs. Unlike recent work that conditions…