565 citations · 1k across the 46 of their papers we have counts for
16 papers · 1 filter
Evaluating Generative Ad Hoc Information Retrieval
Lukas Gienapp, Harrisen Scells, Niklas Deckers +9
Recent advances in large language models have enabled the development of viable generative retrieval systems. Instead of a traditional document ranking, generative retrieval system…
Commercialized Generative AI: A Critical Study of the Feasibility and Ethics of Generating Native Advertising Using Large Language Models in Conversational Web Search
Ines Zelch, Matthias Hagen, Martin Potthast
How will generative AI pay for itself? Unless charging users for access, selling advertising is the only alternative. Especially in the multi-billion dollar web search market with…
Generating Natural Language Queries for More Effective Systematic Review Screening Prioritisation
Shuai Wang, Harrisen Scells, Martin Potthast +2
Screening prioritisation in medical systematic reviews aims to rank the set of documents retrieved by complex Boolean queries. Prioritising the most important documents ensures tha…
The Information Retrieval Experiment Platform
Maik Fröbe, Jan Heinrich Reimer, Sean MacAvaney +6
We integrate ir_datasets, ir_measures, and PyTerrier with TIRA in the Information Retrieval Experiment Platform (TIREx) to promote more standardized, reproducible, scalable, and ev…
Perspectives on Large Language Models for Relevance Judgment
Guglielmo Faggioli, Laura Dietz, Charles Clarke +8
When asked, large language models (LLMs) like ChatGPT claim that they can assist with relevance judgments but it is not clear whether automated judgments can reliably be used in ev…
The Archive Query Log: Mining Millions of Search Result Pages of Hundreds of Search Engines from 25 Years of Web Archives
Jan Heinrich Reimer, Sebastian Schmidt, Maik Fröbe +5
The Archive Query Log (AQL) is a previously unused, comprehensive query log collected at the Internet Archive over the last 25 years. Its first version includes 356 million queries…
Spacerini: Plug-and-play Search Engines with Pyserini and Hugging Face
Christopher Akiki, Odunayo Ogundepo, Aleksandra Piktus +4
We present Spacerini, a tool that integrates the Pyserini toolkit for reproducible information retrieval research with Hugging Face to enable the seamless construction and deployme…
The Infinite Index: Information Retrieval on Generative Text-To-Image Models
Niklas Deckers, Maik Fröbe, Johannes Kiesel +4
Conditional generative models such as DALL-E and Stable Diffusion generate images based on a user-defined text, the prompt. Finding and refining prompts that produce a desired imag…
Sparse Pairwise Re-ranking with Pre-trained Transformers
Lukas Gienapp, Maik Fröbe, Matthias Hagen +1
Pairwise re-ranking models predict which of two documents is more relevant to a query and then aggregate a final ranking from such preferences. This is often more effective than po…
How Train-Test Leakage Affects Zero-shot Retrieval
Maik Fröbe, Christopher Akiki, Martin Potthast +1
Neural retrieval models are often trained on (subsets of) the millions of queries of the MS MARCO / ORCAS datasets and then tested on the 250 Robust04 queries or other TREC benchma…
FastWARC: Optimizing Large-Scale Web Archive Analytics
Janek Bevendorff, Martin Potthast, Benno Stein
Web search and other large-scale web data analytics rely on processing archives of web pages stored in a standardized and efficient format. Since its introduction in 2008, the IIPC…
The Impact of Main Content Extraction on Near-Duplicate Detection
Maik Fröbe, Matthias Hagen, Janek Bevendorff +6
Commercial web search engines employ near-duplicate detection to ensure that users see each relevant result only once, albeit the underlying web crawls typically include (near-)dup…
Abstractive Snippet Generation
Wei-Fan Chen, Shahbaz Syed, Benno Stein +2
An abstractive snippet is an originally created piece of text to summarize a web page on a search engine results page. Compared to the conventional extractive snippets, which are g…
Common Conversational Community Prototype: Scholarly Conversational Assistant
Krisztian Balog, Lucie Flekova, Matthias Hagen +6
This paper discusses the potential for creating academic resources (tools, data, and evaluation approaches) to support research in conversational search, by focusing on realistic i…
Wikipedia Text Reuse: Within and Without
Milad Alshomary, Michael Völske, Tristan Licht +4
We study text reuse related to Wikipedia at scale by compiling the first corpus of text reuse cases within Wikipedia as well as without (i.e., reuse of Wikipedia text in a sample o…
Overview of the Wikidata Vandalism Detection Task at WSDM Cup 2017
Stefan Heindorf, Martin Potthast, Gregor Engels +1
We report on the Wikidata vandalism detection task at the WSDM Cup 2017. The task received five submissions for which this paper describes their evaluation and a comparison to stat…