Mega-COV: A Billion-Scale Dataset of 100+ Languages for COVID-19
arXiv:2005.06012
Abstract
We describe Mega-COV, a billion-scale dataset from Twitter for studying COVID-19. The dataset is diverse (covers 268 countries), longitudinal (goes as back as 2007), multilingual (comes in 100+ languages), and has a significant number of location-tagged tweets (~169M tweets). We release tweet IDs from the dataset. We also develop and release two powerful models, one for identifying whether or not a tweet is related to the pandemic (best F1=97%) and another for detecting misinformation about COVID-19 (best F1=92%). A human annotation study reveals the utility of our models on a subset of Mega-COV. Our data and models can be useful for studying a wide host of phenomena related to the pandemic. Mega-COV and our models are publicly available.
References in corpus (11)
- Where in the World are You? Geolocation and Language Identification in Twitter
- A first look at COVID-19 information and misinformation sharing on Twitter
- CoAID: COVID-19 Healthcare Misinformation Dataset
- Understanding the perception of COVID-19 policies by mining a multilanguage Twitter dataset
- Measuring Emotions in the COVID-19 Real World Worry Dataset
- Topology comparison of Twitter diffusion networks effectively reveals misleading information
- Large Arabic Twitter Dataset on COVID-19
- Understanding and Detecting Dangerous Speech in Social Media
- Leveraging Affective Bidirectional Transformers for Offensive Language Detection
- Facts and Fabrications about Ebola: A Twitter Based Study
- An Information Diffusion Approach to Rumor Propagation and Identification on Twitter