Solving differential equations with unknown constitutive relations as recurrent neural networks
arXiv:1710.02242
Abstract
We solve a system of ordinary differential equations with an unknown functional form of a sink (reaction rate) term. We assume that the measurements (time series) of state variables are partially available, and we use recurrent neural network to "learn" the reaction rate from this data. This is achieved by including a discretized ordinary differential equations as part of a recurrent neural network training problem. We extend TensorFlow's recurrent neural network architecture to create a simple but scalable and effective solver for the unknown functions, and apply it to a fedbatch bioreactor simulation problem. Use of techniques from recent deep learning literature enables training of functions with behavior manifesting over thousands of time steps. Our networks are structurally similar to recurrent neural networks, but differences in design and function require modifications to the conventional wisdom about training such networks.
arXiv comment19 pages, 8 figures
References in corpus (1)
Cited by in corpus (4)
- LaSDI: Parametric Latent Space Dynamics Identification
- FiniteNet: A Fully Convolutional LSTM Network Architecture for Time-Dependent Partial Differential Equations
- An Analysis of an Integrated Mathematical Modeling -- Artificial Neural Network Approach for the Problems with a Limited Learning Dataset
- Unsupervised Learning of Solutions to Differential Equations with Generative Adversarial Networks