30 citations · 129 across the 11 of their papers we have counts for
3 papers · 1 filter
How to Measure the Reproducibility of System-oriented IR Experiments
Timo Breuer, Nicola Ferro, Norbert Fuhr +4
Replicability and reproducibility of experimental results are primary concerns in all the areas of science and IR is not an exception. Besides the problem of moving the field towar…
TREC-COVID: Constructing a Pandemic Information Retrieval Test Collection
Ellen Voorhees, Tasmeer Alam, Steven Bedrick +6
TREC-COVID is a community evaluation designed to build a test collection that captures the information needs of biomedical researchers using the scientific literature during a pand…
HLVU : A New Challenge to Test Deep Understanding of Movies the Way Humans do
Keith Curtis, George Awad, Shahzad Rajput +1
In this paper we propose a new evaluation challenge and direction in the area of High-level Video Understanding. The challenge we are proposing is designed to test automatic video…