Neural networks: solving the chemistry of the interstellar medium

Abstract

Non-equilibrium chemistry is a key process in the study of the InterStellar Medium (ISM), in particular the formation of molecular clouds and thus stars. However, computationally it is among the most difficult tasks to include in astrophysical simulations, because of the typically high (>40) number of reactions, the short evolutionary timescales (about $10^4$ times less than the ISM dynamical time) and the characteristic non-linearity and stiffness of the associated Ordinary Differential Equations system (ODEs). In this proof of concept work, we show that Physics Informed Neural Networks (PINN) are a viable alternative to traditional ODE time integrators for stiff thermo-chemical systems, i.e. up to molecular hydrogen formation (9 species and 46 reactions). Testing different chemical networks in a wide range of densities ($-2<\log n/{\mathrm{cm}}^{-3}<3$) and temperatures ($1<\log T/\mathrm{K}<5$), we find that a basic architecture can give a comfortable convergence only for simplified chemical systems: to properly capture the sudden chemical and thermal variations a Deep Galerkin Method is needed. Once trained ($\sim 10^3$ GPUhr), the PINN well reproduces the strong non-linear nature of the solutions (errors $\lesssim 10\%$) and can give speed-ups up to a factor of $\sim 200$ with respect to traditional ODE solvers. Further, the latter have completion times that vary by about $\sim 30\%$ for different initial $n$ and $T$, while the PINN method gives negligible variations. Both the speed-up and the potential improvement in load balancing imply that PINN-powered simulations are a very palatable way to solve complex chemical calculation in astrophysical and cosmological problems.

arXiv comment16 pages, 12 figures, accepted for publication on MNRAS

References in corpus (34)

• The NumPy array: a structure for efficient numerical computation
• The chemical composition of the Sun
• DGM: A deep learning algorithm for solving partial differential equations
• Radiative transfer in a clumpy universe: IV. New synthesis models of the cosmic UV/X-ray background
• Adaptive activation functions accelerate convergence in deep and physics-informed neural networks
• SciANN: A Keras/Tensorflow wrapper for scientific computations and physics-informed deep learning using artificial neural networks
• P3M-SPH simulations of the Lyman-alpha Forest
• A PDR-Code Comparison Study
• Grackle: a Chemistry and Cooling Library for Astrophysics
• Uncertainties in H2 and HD Chemistry and Cooling and their Role in Early Structure Formation
• KROME - a package to embed chemistry in astrophysical simulations
• Modeling UV Radiation Feedback from Massive Stars: II. Dispersal of Star-Forming Giant Molecular Clouds by Photoionization and Radiation Pressure
• Chemistry in Disks. IV. Benchmarking gas-grain chemical models with surface reactions
• The circumgalactic medium of massive galaxies at z~3: a test for stellar feedback, galactic outflows, and cold streams
• Modelling CO formation in the turbulent interstellar medium
• Physics Informed Neural Networks for Simulating Radiative Transfer
• Metal and molecule cooling in simulations of structure formation
• Metal and molecule cooling in simulations of structure formation
• Deep into the structure of the first galaxies: SERRA views
• UCLCHEM: A Gas-Grain Chemical Code
• When Do Extended Physics-Informed Neural Networks (XPINNs) Improve Generalization?
• The impact of chemistry on the structure of high-z galaxies
• Effects of dust grains on early galaxy evolution
• A survey of high-$z$ galaxies: SERRA simulations
• Machine learning astrophysics from 21 cm lightcones: impact of network architectures and signal contamination
• Photoevaporation of Jeans-unstable molecular clumps
• A chemical model for the interstellar medium in galaxies
• A deep learning model to emulate simulations of cosmic reionization
• Chemulator: Fast, accurate thermochemistry for dynamical models through emulation
• GAME: GAlaxy Machine learning for Emission lines
• Shaping the structure of a GMC with radiation and winds
• H2 chemistry in galaxy simulations: an improved supernova feedback model
• Machine Learning the 6th Dimension: Stellar Radial Velocities from 5D Phase-Space Correlations
• The Astrochemical Evolution of Turbulent Giant Molecular Clouds : I - Physical Processes and Method of Solution for Hydrodynamic, Embedded Starless Clouds

Cited by in corpus (5)

• Stochastic star formation in early galaxies: JWST implications
• NeuralPDR: Neural Differential Equations as surrogate models for Photodissociation Regions
• Neural-Network Chemical Emulator for First-Star Formation: Robust Iterative Predictions over a Wide Density Range
• Neural Infalling Cloud Equations (NICE): Increasing the Efficacy of Subgrid Models and Scientific Equation Discovery using Neural ODEs and Symbolic Regression
• Systematic selection of surrogate models for nonequilibrium chemistry