Learning Lyapunov Functions for Piecewise Affine Systems with Neural Network Controllers
arXiv:2008.06546
Abstract
We propose a learning-based method for Lyapunov stability analysis of piecewise affine dynamical systems in feedback with piecewise affine neural network controllers. The proposed method consists of an iterative interaction between a learner and a verifier, where in each iteration, the learner uses a collection of samples of the closed-loop system to propose a Lyapunov function candidate as the solution to a convex program. The learner then queries the verifier, which solves a mixed-integer program to either validate the proposed Lyapunov function candidate or reject it with a counterexample, i.e., a state where the stability condition fails. This counterexample is then added to the sample set of the learner to refine the set of Lyapunov function candidates. We design the learner and the verifier based on the analytic center cutting-plane method, in which the verifier acts as the cutting-plane oracle to refine the set of Lyapunov function candidates. We show that when the set of Lyapunov functions is full-dimensional in the parameter space, the overall procedure finds a Lyapunov function in a finite number of iterations. We demonstrate the utility of the proposed method in searching for quadratic and piecewise quadratic Lyapunov functions.
References in corpus (17)
- Sequence to Sequence Learning with Neural Networks
- Provable defenses against adversarial examples via the convex outer adversarial polytope
- Efficient Neural Network Robustness Certification with General Activation Functions
- Evaluating Robustness of Neural Networks with Mixed Integer Programming
- Efficient representation and approximation of model predictive control laws via deep learning
- Formal Guarantees on the Robustness of a Classifier against Adversarial Manipulation
- An approach to reachability analysis for feed-forward ReLU neural networks
- Semidefinite relaxations for certifying robustness to adversarial examples
- Efficient Formal Safety Analysis of Neural Networks
- Formal Synthesis of Lyapunov Neural Networks
- On the number of response regions of deep feed forward networks with piece-wise linear activations
- Output Range Analysis for Deep Neural Networks
- Learning Control Lyapunov Functions from Counterexamples and Demonstrations
- Automated and Sound Synthesis of Lyapunov Functions with SMT Solvers
- Learning Stability Certificates from Data
- Stability-certified reinforcement learning: A control-theoretic perspective
- Stability Analysis using Quadratic Constraints for Systems with Neural Network Controllers