Overview of BioASQ 2020: The eighth BioASQ challenge on Large-Scale Biomedical Semantic Indexing and Question Answering

Abstract

In this paper, we present an overview of the eighth edition of the BioASQ challenge, which ran as a lab in the Conference and Labs of the Evaluation Forum (CLEF) 2020. BioASQ is a series of challenges aiming at the promotion of systems and methodologies for large-scale biomedical semantic indexing and question answering. To this end, shared tasks are organized yearly since 2012, where different teams develop systems that compete on the same demanding benchmark datasets that represent the real information needs of experts in the biomedical domain. This year, the challenge has been extended with the introduction of a new task on medical semantic indexing in Spanish. In total, 34 teams with more than 100 systems participated in the three tasks of the challenge. As in previous years, the results of the evaluation reveal that the top-performing systems managed to outperform the strong baselines, which suggests that state-of-the-art systems keep pushing the frontier of research through continuous improvements.

arXiv comment21 pages, 10 tables, 3 figures

References in corpus (17)

• BioBERT: a pre-trained biomedical language representation model for biomedical text mining
• Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
• LexRank: Graph-based Lexical Centrality as Salience in Text Summarization
• mT5: A massively multilingual pre-trained text-to-text transformer
• CORD-19: The COVID-19 Open Research Dataset
• ScispaCy: Fast and Robust Models for Biomedical Natural Language Processing
• DeepRank: A New Deep Architecture for Relevance Ranking in Information Retrieval
• Evaluation Measures for Hierarchical Classification: a unified view and novel approaches
• AttentionXML: Label Tree-based Attention-Aware Deep Model for High-Performance Extreme Multi-Label Text Classification
• Overview of BioASQ 2021: The ninth BioASQ challenge on Large-Scale Biomedical Semantic Indexing and Question Answering
• Results of the seventh edition of the BioASQ Challenge
• Sequence tagging for biomedical extractive question answering
• Taming Pretrained Transformers for Extreme Multi-label Text Classification
• Classification Betters Regression in Query-based Multi-document Summarisation Techniques for Question Answering: Macquarie University at BioASQ7b
• Query Focused Multi-document Summarisation of Biomedical Texts
• Transformer-based Language Models for Factoid Question Answering at BioASQ9b
• Query-Focused Extractive Summarisation for Finding Ideal Answers to Biomedical and COVID-19 Questions

Cited by in corpus (6)

• Biomedical Question Answering: A Survey of Approaches and Challenges
• Overview of BioASQ 2021: The ninth BioASQ challenge on Large-Scale Biomedical Semantic Indexing and Question Answering
• Overview of BioASQ 2022: The tenth BioASQ challenge on Large-Scale Biomedical Semantic Indexing and Question Answering
• Sequence tagging for biomedical extractive question answering
• Overview of BioASQ 2023: The eleventh BioASQ challenge on Large-Scale Biomedical Semantic Indexing and Question Answering
• Overview of BioASQ 2024: The twelfth BioASQ challenge on Large-Scale Biomedical Semantic Indexing and Question Answering