Adapting Physics-Informed Neural Networks to Improve ODE Optimization in Mosquito Population Dynamics

Abstract

Physics informed neural networks have been gaining popularity due to their unique ability to incorporate physics laws into data-driven models, ensuring that the predictions are not only consistent with empirical data but also align with domain-specific knowledge in the form of physics equations. The integration of physics principles enables the method to require less data while maintaining the robustness of deep learning in modelling complex dynamical systems. However, current PINN frameworks are not sufficiently mature for real-world ODE systems, especially those with extreme multi-scale behavior such as mosquito population dynamical modelling. In this research, we propose a PINN framework with several improvements for forward and inverse problems for ODE systems with a case study application in modelling the dynamics of mosquito populations. The framework tackles the gradient imbalance and stiff problems posed by mosquito ordinary differential equations. The method offers a simple but effective way to resolve the time causality issue in PINNs by gradually expanding the training time domain until it covers entire domain of interest. As part of a robust evaluation, we conduct experiments using simulated data to evaluate the effectiveness of the approach. Preliminary results indicate that physics-informed machine learning holds significant potential for advancing the study of ecological systems.

References in corpus (25)

• Adam: A Method for Stochastic Optimization
• SciPy 1.0--Fundamental Algorithms for Scientific Computing in Python
• PyTorch: An Imperative Style, High-Performance Deep Learning Library
• DeepXDE: A deep learning library for solving differential equations
• Adaptive activation functions accelerate convergence in deep and physics-informed neural networks
• On the eigenvector bias of Fourier feature networks: From regression to solving multi-scale PDEs with physics-informed neural networks
• A comprehensive study of non-adaptive and residual-based adaptive sampling for physics-informed neural networks
• PhyGeoNet: Physics-Informed Geometry-Adaptive Convolutional Neural Networks for Solving Parameterized Steady-State PDEs on Irregular Domain
• Finite Basis Physics-Informed Neural Networks (FBPINNs): a scalable domain decomposition approach for solving differential equations
• Efficient training of physics-informed neural networks via importance sampling
• A Physics Informed Neural Network for Time-Dependent Nonlinear and Higher Order Partial Differential Equations
• PhyCRNet: Physics-informed Convolutional-Recurrent Network for Solving Spatiotemporal PDEs
• Locally adaptive activation functions with slope recovery term for deep and physics-informed neural networks
• Understanding and mitigating gradient pathologies in physics-informed neural networks
• Biologically-informed neural networks guide mechanistic modeling from sparse experimental data
• When and why PINNs fail to train: A neural tangent kernel perspective
• Characterizing possible failure modes in physics-informed neural networks
• Physics-Informed Machine Learning: A Survey on Problems, Methods and Applications
• Physics-informed neural networks (PINNs) for fluid mechanics: A review
• Solving Allen-Cahn and Cahn-Hilliard Equations using the Adaptive Physics Informed Neural Networks
• Respecting causality is all you need for training physics-informed neural networks
• DAS-PINNs: A deep adaptive sampling method for solving high-dimensional partial differential equations
• FinRL-Meta: Market Environments and Benchmarks for Data-Driven Financial Reinforcement Learning
• A Survey on Evaluation of Out-of-Distribution Generalization
• Physics-Informed Computer Vision: A Review and Perspectives