Learning Density Distribution of Reachable States for Autonomous Systems

Abstract

State density distribution, in contrast to worst-case reachability, can be leveraged for safety-related problems to better quantify the likelihood of the risk for potentially hazardous situations. In this work, we propose a data-driven method to compute the density distribution of reachable states for nonlinear and even black-box systems. Our semi-supervised approach learns system dynamics and the state density jointly from trajectory data, guided by the fact that the state density evolution follows the Liouville partial differential equation. With the help of neural network reachability tools, our approach can estimate the set of all possible future states as well as their density. Moreover, we could perform online safety verification with probability ranges for unsafe behaviors to occur. We use an extensive set of experiments to show that our learned solution can produce a much more accurate estimate on density distribution, and can quantify risks less conservatively and flexibly comparing with worst-case analysis.

arXiv commentAccepted at CoRL 2021

References in corpus (13)

• PyTorch: An Imperative Style, High-Performance Deep Learning Library
• Continuous control with deep reinforcement learning
• DGM: A deep learning algorithm for solving partial differential equations
• Fourier Neural Operator for Parametric Partial Differential Equations
• A unified deep artificial neural network approach to partial differential equations in complex geometries
• Quantifying total uncertainty in physics-informed neural networks for solving forward and inverse stochastic problems
• Algorithms for Solving High Dimensional PDEs: From Nonlinear Monte Carlo to Machine Learning
• Neural Lyapunov Control
• Output Range Analysis for Deep Neural Networks
• PyDEns: a Python Framework for Solving Differential Equations with Neural Networks
• Sampling-based Reachability Analysis: A Random Set Theory Approach with Adversarial Sampling
• Reachability Analysis for Feed-Forward Neural Networks using Face Lattices
• Density Propagation with Characteristics-based Deep Learning