SympNets: Intrinsic structure-preserving symplectic networks for identifying Hamiltonian systems
arXiv:2001.03750
Abstract
We propose new symplectic networks (SympNets) for identifying Hamiltonian systems from data based on a composition of linear, activation and gradient modules. In particular, we define two classes of SympNets: the LA-SympNets composed of linear and activation modules, and the G-SympNets composed of gradient modules. Correspondingly, we prove two new universal approximation theorems that demonstrate that SympNets can approximate arbitrary symplectic maps based on appropriate activation functions. We then perform several experiments including the pendulum, double pendulum and three-body problems to investigate the expressivity and the generalization ability of SympNets. The simulation results show that even very small size SympNets can generalize well, and are able to handle both separable and non-separable Hamiltonian systems with data points resulting from short or long time steps. In all the test cases, SympNets outperform the baseline models, and are much faster in training and prediction. We also develop an extended version of SympNets to learn the dynamics from irregularly sampled data. This extended version of SympNets can be thought of as a universal model representing the solution to an arbitrary Hamiltonian system.
References in corpus (9)
- NICE: Non-linear Independent Components Estimation
- Multistep Neural Networks for Data-driven Discovery of Nonlinear Dynamical Systems
- Symplectic ODE-Net: Learning Hamiltonian Dynamics with Control
- Hamiltonian Graph Networks with ODE Integrators
- Symplectic Neural Networks in Taylor Series Form for Hamiltonian Systems
- Neural Canonical Transformation with Symplectic Flows
- Learning Symmetries of Classical Integrable Systems
- Quantifying the generalization error in deep learning in terms of data distribution and neural network smoothness
- Unit triangular factorization of the matrix symplectic group