7 papers
Formalized Information Needs Improve Large-Language-Model Relevance Judgments
Jüri Keller, Maik Fröbe, Björn Engelmann +4
Cranfield-style retrieval evaluations with too few or too many relevant documents or with low inter-assessor agreement on relevance can reduce the reliability of observations. In e…
Dynamics in Search Engine Query Suggestions for European Politicians
Franziska Pradel, Fabian Haak, Sven-Oliver Proksch +1
Search engines are commonly used for online political information seeking. Yet, it remains unclear how search query suggestions for political searches that reflect the latent inter…
Perception-Aware Bias Detection for Query Suggestions
Fabian Haak, Philipp Schaer
Bias in web search has been in the spotlight of bias detection research for quite a while. At the same time, little attention has been paid to query suggestions in this regard. Awa…
Auditing Search Query Suggestion Bias Through Recursive Algorithm Interrogation
Fabian Haak, Philipp Schaer
Despite their important role in online information search, search query suggestions have not been researched as much as most other aspects of search engines. Although reasons for t…
Pairwise Comparison for Bias Identification and Quantification
Fabian Haak, Philipp Schaer
Linguistic bias in online news and social media is widespread but difficult to measure. Yet, its identification and quantification remain difficult due to subjectivity, context dep…
REANIMATOR: Reanimate Retrieval Test Collections with Extracted and Synthetic Resources
Björn Engelmann, Fabian Haak, Philipp Schaer +3
Retrieval test collections are essential for evaluating information retrieval systems, yet they often lack generalizability across tasks. To overcome this limitation, we introduce…