Deep Epidemiological Modeling by Black-box Knowledge Distillation: An Accurate Deep Learning Model for COVID-19

Abstract

An accurate and efficient forecasting system is imperative to the prevention of emerging infectious diseases such as COVID-19 in public health. This system requires accurate transient modeling, lower computation cost, and fewer observation data. To tackle these three challenges, we propose a novel deep learning approach using black-box knowledge distillation for both accurate and efficient transmission dynamics prediction in a practical manner. First, we leverage mixture models to develop an accurate, comprehensive, yet impractical simulation system. Next, we use simulated observation sequences to query the simulation system to retrieve simulated projection sequences as knowledge. Then, with the obtained query data, sequence mixup is proposed to improve query efficiency, increase knowledge diversity, and boost distillation model accuracy. Finally, we train a student deep neural network with the retrieved and mixed observation-projection sequences for practical use. The case study on COVID-19 justifies that our approach accurately projects infections with much lower computation cost when observation data are limited.

arXiv commentAccepted by AAAI-21/IAAI-21, 7 pages, 2 figures

References in corpus (8)

• Distilling the Knowledge in a Neural Network
• mixup: Beyond Empirical Risk Minimization
• AutoAugment: Learning Augmentation Policies from Data
• Accurate estimation of influenza epidemics using Google search data via ARGO
• Evaluating epidemic forecasts in an interval format
• Learning from Between-class Examples for Deep Sound Recognition
• Artificial Intelligence Forecasting of Covid-19 in China
• Relational Knowledge Distillation