3 papers
cs.IR2026
Revisiting Human-vs-LLM judgments using the TREC Podcast Track
Watheq Mansour, J. Shane Culpepper, Joel Mackenzie +1
Using large language models (LLMs) to annotate relevance is an increasingly important technique in the information retrieval community. While some studies demonstrate that LLMs can…
cs.IR2025
The Effects of Demographic Instructions on LLM Personas
Angel Felipe Magnossão de Paula, J. Shane Culpepper, Alistair Moffat +3
Social media platforms must filter sexist content in compliance with governmental regulations. Current machine learning approaches can reliably detect sexism based on standardized…
cs.DB2025
Distinctiveness Maximization in Datasets Assemblage
Tingting Wang, Shixun Huang, Zhifeng Bao +3
In this paper, given a user's query set and budget, we aim to use the limited budget to help users assemble a set of datasets that can enrich a base dataset by introducing the maxi…