repro_eval: A Python Interface to Reproducibility Measures of System-oriented IR Experiments
arXiv:2201.07599 · doi:10.1007/978-3-030-72240-1_51
Abstract
In this work we introduce repro_eval - a tool for reactive reproducibility studies of system-oriented information retrieval (IR) experiments. The corresponding Python package provides IR researchers with measures for different levels of reproduction when evaluating their systems' outputs. By offering an easily extensible interface, we hope to stimulate common practices when conducting a reproducibility study of system-oriented IR experiments.
arXiv commentAccepted at ECIR21. The final authenticated version is available online at https://doi.org/10.1007/978-3-030-72240-1_51
References in corpus (3)
Cited by in corpus (4)
- The Information Retrieval Experiment Platform
- Towards Robust Expert Finding in Community Question Answering Platforms
- Simplified Longitudinal Retrieval Experiments: A Case Study on Query Expansion and Document Boosting
- Evaluating Elements of Web-based Data Enrichment for Pseudo-Relevance Feedback Retrieval