Learning Continuous Network Emerging Dynamics from Scarce Observations via Data-Adaptive Stochastic Processes

Abstract

Learning network dynamics from the empirical structure and spatio-temporal observation data is crucial to revealing the interaction mechanisms of complex networks in a wide range of domains. However, most existing methods only aim at learning network dynamic behaviors generated by a specific ordinary differential equation instance, resulting in ineffectiveness for new ones, and generally require dense observations. The observed data, especially from network emerging dynamics, are usually difficult to obtain, which brings trouble to model learning. Therefore, how to learn accurate network dynamics with sparse, irregularly-sampled, partial, and noisy observations remains a fundamental challenge. We introduce Neural ODE Processes for Network Dynamics (NDP4ND), a new class of stochastic processes governed by stochastic data-adaptive network dynamics, to overcome the challenge and learn continuous network dynamics from scarce observations. Intensive experiments conducted on various network dynamics in ecological population evolution, phototaxis movement, brain activity, epidemic spreading, and real-world empirical systems, demonstrate that the proposed method has excellent data adaptability and computational efficiency, and can adapt to unseen network emerging dynamics, producing accurate interpolation and extrapolation with reducing the ratio of required observation data to only about 6\% and improving the learning speed for new dynamics by three orders of magnitude.

arXiv commentpreprint

References in corpus (14)

• Learning to Simulate Complex Physics with Graph Networks
• Closed-form Continuous-time Neural Models
• Model selection for dynamical systems via sparse regression and information criteria
• Data-Driven Control of Complex Networks
• Nonparametric inference of interaction laws in systems of agents from trajectory data
• FitzHugh-Nagumo oscillators on complex networks mimic epileptic-seizure-related synchronization phenomena
• Data-driven discovery of intrinsic dynamics
• Autonomous inference of complex network dynamics from incomplete and noisy data
• Deep learning of contagion dynamics on complex networks
• Graph Neural Ordinary Differential Equations
• A General Deep Learning Framework for Network Reconstruction and Dynamics Learning
• Enhanced spatio-temporal electric load forecasts using less data with active deep learning
• Meta-Learning Stationary Stochastic Process Prediction with Convolutional Neural Processes
• Autoregressive GNN-ODE GRU Model for Network Dynamics