Integrating Expert ODEs into Neural ODEs: Pharmacology and Disease Progression

Abstract

Modeling a system's temporal behaviour in reaction to external stimuli is a fundamental problem in many areas. Pure Machine Learning (ML) approaches often fail in the small sample regime and cannot provide actionable insights beyond predictions. A promising modification has been to incorporate expert domain knowledge into ML models. The application we consider is predicting the progression of disease under medications, where a plethora of domain knowledge is available from pharmacology. Pharmacological models describe the dynamics of carefully-chosen medically meaningful variables in terms of systems of Ordinary Differential Equations (ODEs). However, these models only describe a limited collection of variables, and these variables are often not observable in clinical environments. To close this gap, we propose the latent hybridisation model (LHM) that integrates a system of expert-designed ODEs with machine-learned Neural ODEs to fully describe the dynamics of the system and to link the expert and latent variables to observable quantities. We evaluated LHM on synthetic data as well as real-world intensive care data of COVID-19 patients. LHM consistently outperforms previous works, especially when few training samples are available such as at the beginning of the pandemic.

References in corpus (11)

• Auto-Encoding Variational Bayes
• Discovering governing equations from data: Sparse identification of nonlinear dynamical systems
• DGM: A deep learning algorithm for solving partial differential equations
• Solving the Quantum Many-Body Problem with Artificial Neural Networks
• Solving high-dimensional partial differential equations using deep learning
• Variational Inference with Normalizing Flows
• Tensor field networks: Rotation- and translation-equivariant neural networks for 3D point clouds
• Learning Independent Causal Mechanisms
• Hybrid modeling and prediction of dynamical systems
• Deep Density: circumventing the Kohn-Sham equations via symmetry preserving neural networks
• Neural Pharmacodynamic State Space Modeling

Cited by in corpus (2)

• Fully probabilistic deep models for forward and inverse problems in parametric PDEs
• Physics-Integrated Variational Autoencoders for Robust and Interpretable Generative Modeling