35 citations · 105 across the 10 of their papers we have counts for
10 papers
Overview of the CLEF-2019 CheckThat!: Automatic Identification and Verification of Claims
Tamer Elsayed, Preslav Nakov, Alberto Barrón-Cedeño +4
We present an overview of the second edition of the CheckThat! Lab at CLEF 2019. The lab featured two tasks in two different languages: English and Arabic. Task 1 (English) challen…
ArCOV-19: The First Arabic COVID-19 Twitter Dataset with Propagation Networks
Fatima Haouari, Maram Hasanain, Reem Suwaileh +1
In this paper, we present ArCOV-19, an Arabic COVID-19 Twitter dataset that spans one year, covering the period from 27th of January 2020 till 31st of January 2021. ArCOV-19 is the…
CheckThat! at CLEF 2020: Enabling the Automatic Identification and Verification of Claims in Social Media
Alberto Barron-Cedeno, Tamer Elsayed, Preslav Nakov +4
We describe the third edition of the CheckThat! Lab, which is part of the 2020 Cross-Language Evaluation Forum (CLEF). CheckThat! proposes four complementary tasks and a related ta…
Embedding-based Qualitative Analysis of Polarization in Turkey
Mucahid Kutlu, Kareem Darwish, Cansin Bayrak +2
On June 24, 2018, Turkey conducted a highly-consequential election in which the Turkish people elected their president and parliament in the first election under a new presidential…
Overview of the CLEF-2018 CheckThat! Lab on Automatic Identification and Verification of Political Claims. Task 1: Check-Worthiness
Pepa Atanasova, Alberto Barron-Cedeno, Tamer Elsayed +5
We present an overview of the CLEF-2018 CheckThat! Lab on Automatic Identification and Verification of Political Claims, with focus on Task 1: Check-Worthiness. The task asks to pr…
Devam vs. Tamam: 2018 Turkish Elections
Mucahid Kutlu, Kareem Darwish, Tamer Elsayed
On June 24, 2018, Turkey held a historical election, transforming its parliamentary system to a presidential one. One of the main questions for Turkish voters was whether to start…
Mix and Match: Collaborative Expert-Crowd Judging for Building Test Collections Accurately and Affordably
Mucahid Kutlu, Tyler McDonnell, Aashish Sheshadri +2
Crowdsourcing offers an affordable and scalable means to collect relevance judgments for IR test collections. However, crowd assessors may show higher variance in judgment quality…
Efficient Test Collection Construction via Active Learning
Md Mustafizur Rahman, Mucahid Kutlu, Tamer Elsayed +1
To create a new IR test collection at low cost, it is valuable to carefully select which documents merit human relevance judgments. Shared task campaigns such as NIST TREC pool doc…
EveTAR: Building a Large-Scale Multi-Task Test Collection over Arabic Tweets
Maram Hasanain, Reem Suwaileh, Tamer Elsayed +2
This article introduces a new language-independent approach for creating a large-scale high-quality test collection of tweets that supports multiple information retrieval (IR) task…
Intelligent Topic Selection for Low-Cost Information Retrieval Evaluation: A New Perspective on Deep vs. Shallow Judging
Mucahid Kutlu, Tamer Elsayed, Matthew Lease
While test collections provide the cornerstone for Cranfield-based evaluation of information retrieval (IR) systems, it has become practically infeasible to rely on traditional poo…