CORD-19: The COVID-19 Open Research Dataset
arXiv:2004.10706
Abstract
The COVID-19 Open Research Dataset (CORD-19) is a growing resource of scientific papers on COVID-19 and related historical coronavirus research. CORD-19 is designed to facilitate the development of text mining and information retrieval systems over its rich collection of metadata and structured full text papers. Since its release, CORD-19 has been downloaded over 200K times and has served as the basis of many COVID-19 text mining and discovery systems. In this article, we describe the mechanics of dataset construction, highlighting challenges and key design decisions, provide an overview of how CORD-19 has been used, and describe several shared tasks built around the dataset. We hope this resource will continue to bring together the computing community, biomedical experts, and policy makers in the search for effective treatments and management policies for COVID-19.
arXiv commentACL NLP-COVID Workshop 2020
References in corpus (8)
- BioBERT: a pre-trained biomedical language representation model for biomedical text mining
- Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
- How many preprints have actually been printed and why: a case study of computer science preprints on arXiv
- Comprehensive Named Entity Recognition on CORD-19 with Distant or Weak Supervision
- Rapidly Deploying a Neural Search Engine for the COVID-19 Open Research Dataset: Preliminary Thoughts and Lessons Learned
- Real-Time Open-Domain Question Answering with Dense-Sparse Phrase Index
- Information Mining for COVID-19 Research From a Large Volume of Scientific Literature
- Identifying Radiological Findings Related to COVID-19 from Medical Literature
Cited by in corpus (85)
- Drug Repurposing for COVID-19 via Knowledge Graph Completion
- Information Retrieval: Recent Advances and Beyond
- Blended RAG: Improving RAG (Retriever-Augmented Generation) Accuracy with Semantic Search and Hybrid Query-Based Retrievers
- Biomedical Question Answering: A Survey of Approaches and Challenges
- Ontology-driven weak supervision for clinical entity classification in electronic health records
- COVID-19 SignSym: a fast adaptation of a general clinical NLP tool to identify and normalize COVID-19 signs and symptoms to OMOP common data model
- Diagnosis of COVID-19 Using Machine Learning and Deep Learning: A review
- The Information Retrieval Experiment Platform
- The Expando-Mono-Duo Design Pattern for Text Ranking with Pretrained Sequence-to-Sequence Models
- Overview of BioASQ 2021: The ninth BioASQ challenge on Large-Scale Biomedical Semantic Indexing and Question Answering
- Overview of BioASQ 2020: The eighth BioASQ challenge on Large-Scale Biomedical Semantic Indexing and Question Answering
- Pre-trained Language Models in Biomedical Domain: A Systematic Survey
- CO-Search: COVID-19 Information Retrieval with Semantic Search, Question Answering, and Abstractive Summarization
- TREC-COVID: Constructing a Pandemic Information Retrieval Test Collection
- Overview of BioASQ 2022: The tenth BioASQ challenge on Large-Scale Biomedical Semantic Indexing and Question Answering
- Is Coronavirus-Related Research Becoming More Interdisciplinary? A Perspective of Co-occurrence Analysis and Diversity Measure of Scientific Articles
- Testing the Generalization of Neural Language Models for COVID-19 Misinformation Detection
- Fusion: Efficient and Secure Inference Resilient to Malicious Servers
- End-to-End QA on COVID-19: Domain Adaptation with Synthetic Training
- Tracking the Twitter attention around the research efforts on the COVID-19 pandemic
- COVID-19-CT-CXR: a freely accessible and weakly labeled chest X-ray and CT image collection on COVID-19 from biomedical literature
- AraCOVID19-MFH: Arabic COVID-19 Multi-label Fake News and Hate Speech Detection Dataset
- Domain-Specific Pretraining for Vertical Search: Case Study on Biomedical Literature
- Overview of the BioLaySumm 2023 Shared Task on Lay Summarization of Biomedical Research Articles
- Efficient Attentions for Long Document Summarization
- Low Resource Recognition and Linking of Biomedical Concepts from a Large Ontology
- Exploration and Discovery of the COVID-19 Literature through Semantic Visualization
- Entity Recognition from Colloquial Text
- Risk Communication in Asian Countries: COVID-19 Discourse on Twitter
- Drugs4Covid: Drug-driven Knowledge Exploitation based on Scientific Publications
- Kamino: Constraint-Aware Differentially Private Data Synthesis
- CAiRE-COVID: A Question Answering and Query-focused Multi-Document Summarization System for COVID-19 Scholarly Information Management
- COVID-19 Smart Chatbot Prototype for Patient Monitoring
- Rank-DistiLLM: Closing the Effectiveness Gap Between Cross-Encoders and LLMs for Passage Re-Ranking
- CMT in TREC-COVID Round 2: Mitigating the Generalization Gaps from Web to Special Domain Search
- Answering Questions on COVID-19 in Real-Time
- Extracting Summary Knowledge Graphs from Long Documents
- Large-Scale Knowledge Synthesis and Complex Information Retrieval from Biomedical Documents
- Visualization of Diseases at Risk in the COVID-19 Literature
- Set-Encoder: Permutation-Invariant Inter-Passage Attention for Listwise Passage Re-Ranking with Cross-Encoders
- Extracting a Knowledge Base of Mechanisms from COVID-19 Papers
- Model Generalization on COVID-19 Fake News Detection
- Exploring Descriptions of Movement Through Geovisual Analytics
- S2ORC: The Semantic Scholar Open Research Corpus
- What's New? Summarizing Contributions in Scientific Literature
- Extracting Qualitative Causal Structure with Transformer-Based NLP
- Meta-research on COVID-19: An overview of the early trends
- Investigating the Effects of Sparse Attention on Cross-Encoders
- AspectCSE: Sentence Embeddings for Aspect-based Semantic Textual Similarity Using Contrastive Learning and Structured Knowledge
- Searching Scientific Literature for Answers on COVID-19 Questions
- Denmark's Participation in the Search Engine TREC COVID-19 Challenge: Lessons Learned about Searching for Precise Biomedical Scientific Information on COVID-19
- Improving Clinical Document Understanding on COVID-19 Research with Spark NLP
- Checkovid: A COVID-19 misinformation detection system on Twitter using network and content mining perspectives
- MMCoVaR: Multimodal COVID-19 Vaccine Focused Data Repository for Fake News Detection and a Baseline Architecture for Classification
- Searching COVID-19 Clinical Research Using Graph Queries: Algorithm Development and Validation
- A Comparative Study on Transfer Learning and Distance Metrics in Semantic Clustering over the COVID-19 Tweets
- Ontology-based and User-focused Automatic Text Summarization (OATS): Using COVID-19 Risk Factors as an Example
- Repurposing TREC-COVID Annotations to Answer the Key Questions of CORD-19
- COVID-19 and Big Data: Multi-faceted Analysis for Spatio-temporal Understanding of the Pandemic with Social Media Conversations
- Prioritization of COVID-19-related literature via unsupervised keyphrase extraction and document representation learning
- CovidExplorer: A Multi-faceted AI-based Search and Visualization Engine for COVID-19 Information
- COVID-19 Multidimensional Kaggle Literature Organization
- An Open-Publishing Response to the COVID-19 Infodemic
- Boosting Low-Resource Biomedical QA via Entity-Aware Masking Strategies
- Interactive Extractive Search over Biomedical Corpora
- Interpretable Self-supervised Multi-task Learning for COVID-19 Information Retrieval and Extraction
- Unsupervised Text Mining of COVID-19 Records
- MS MARCO: Benchmarking Ranking Models in the Large-Data Regime
- Can questions summarize a corpus? Using question generation for characterizing COVID-19 research
- COVIDRead: A Large-scale Question Answering Dataset on COVID-19
- COVID-19: Comparative Analysis of Methods for Identifying Articles Related to Therapeutics and Vaccines without Using Labeled Data
- Pulse of the Pandemic: Iterative Topic Filtering for Clinical Information Extraction from Social Media
- Tracking Short-Term Temporal Linguistic Dynamics to Characterize Candidate Therapeutics for COVID-19 in the CORD-19 Corpus
- UCD-CS at W-NUT 2020 Shared Task-3: A Text to Text Approach for COVID-19 Event Extraction on Social Media
- Predicting Clinical Trial Results by Implicit Evidence Integration
- COUGH: A Challenge Dataset and Models for COVID-19 FAQ Retrieval
- Medical Literature Mining and Retrieval in a Conversational Setting
- Semantic Frame Forecast
- Extracting Fine-Grained Knowledge Graphs of Scientific Claims: Dataset and Transformer-Based Results
- Uncovering the Corona Virus Map Using Deep Entities and Relationship Models
- Collecting a Large-Scale Gender Bias Dataset for Coreference Resolution and Machine Translation
- RMITB at TREC COVID 2020
- Using Text Analytics for Health to Get Meaningful Insights from a Corpus of COVID Scientific Papers
- Diachronic Text Mining Investigation of Therapeutic Candidates for COVID-19
- Near-imperceptible Neural Linguistic Steganography via Self-Adjusting Arithmetic Coding