most citedBEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Models

27 citations · 45 across the 4 of their papers we have counts for

collaborators

5 papers

cs.CL2023★ 1 cited

Surveying (Dis)Parities and Concerns of Compute Hungry NLP Research

Ji-Ung Lee, Haritz Puerto, Betty van Aken +8

Many recent improvements in NLP stem from the development and use of large pre-trained language models (PLMs) with billions of parameters. Large model sizes makes computational cos…

cs.CL2021★ 11 cited

Learning to Reason for Text Generation from Scientific Tables

Nafise Sadat Moosavi, Andreas Rücklé, Dan Roth +1

In this paper, we introduce SciGen, a new challenge dataset for the task of reasoning-aware data-to-text generation consisting of tables from scientific articles and their correspo…

cs.IR2021★ 27 cited

BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Models

Nandan Thakur, Nils Reimers, Andreas Rücklé +2

Existing neural information retrieval (IR) models have often been studied in homogeneous and narrow settings, which has considerably limited insights into their out-of-distribution…

cs.CL2021

What to Pre-Train on? Efficient Intermediate Task Selection

Clifton Poth, Jonas Pfeiffer, Andreas Rücklé +1

Intermediate task fine-tuning has been shown to culminate in large transfer gains across many NLP tasks. With an abundance of candidate datasets as well as pre-trained language mod…

cs.CL2021★ 6 cited

TWEAC: Transformer with Extendable QA Agent Classifiers

Gregor Geigle, Nils Reimers, Andreas Rücklé +1

Question answering systems should help users to access knowledge on a broad range of topics and to answer a wide array of different questions. Most systems fall short of this expec…