LQResNet: A Deep Neural Network Architecture for Learning Dynamic Processes

Abstract

Mathematical modeling is an essential step, for example, to analyze the transient behavior of a dynamical process and to perform engineering studies such as optimization and control. With the help of first-principles and expert knowledge, a dynamic model can be built, but for complex dynamic processes, appearing, e.g., in biology, chemical plants, neuroscience, financial markets, this often remains an onerous task. Hence, data-driven modeling of the dynamics process becomes an attractive choice and is supported by the rapid advancement in sensor and measurement technology. A data-driven approach, namely operator inference framework, models a dynamic process, where a particular structure of the nonlinear term is assumed. In this work, we suggest combining the operator inference with certain deep neural network approaches to infer the unknown nonlinear dynamics of the system. The approach uses recent advancements in deep learning and possible prior knowledge of the process if possible. We also briefly discuss several extensions and advantages of the proposed methodology. We demonstrate that the proposed methodology accomplishes the desired tasks for dynamics processes encountered in neural dynamics and the glycolytic oscillator.

References in corpus (11)

• Adam: A Method for Stochastic Optimization
• Discovering governing equations from data: Sparse identification of nonlinear dynamical systems
• Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs)
• On the Variance of the Adaptive Learning Rate and Beyond
• Predicting catastrophes in nonlinear dynamical systems by compressive sensing
• Lift & Learn: Physics-informed machine learning for large-scale nonlinear dynamical systems
• Compressed Modes for Variational Problems in Mathematics and Physics
• Deep learning of dynamics and signal-noise decomposition with time-stepping constraints
• Sparse Dynamics for Partial Differential Equations
• Operator inference for non-intrusive model reduction of systems with non-polynomial nonlinear terms
• Efficient inference of parsimonious phenomenological models of cellular dynamics using S-systems and alternating regression

Cited by in corpus (1)

• Learning Low-Dimensional Quadratic-Embeddings of High-Fidelity Nonlinear Dynamics using Deep Learning