Contraction Theory for Nonlinear Stability Analysis and Learning-based Control: A Tutorial Overview

Abstract

Contraction theory is an analytical tool to study differential dynamics of a non-autonomous (i.e., time-varying) nonlinear system under a contraction metric defined with a uniformly positive definite matrix, the existence of which results in a necessary and sufficient characterization of incremental exponential stability of multiple solution trajectories with respect to each other. By using a squared differential length as a Lyapunov-like function, its nonlinear stability analysis boils down to finding a suitable contraction metric that satisfies a stability condition expressed as a linear matrix inequality, indicating that many parallels can be drawn between well-known linear systems theory and contraction theory for nonlinear systems. Furthermore, contraction theory takes advantage of a superior robustness property of exponential stability used in conjunction with the comparison lemma. This yields much-needed safety and stability guarantees for neural network-based control and estimation schemes, without resorting to a more involved method of using uniform asymptotic stability for input-to-state stability. Such distinctive features permit the systematic construction of a contraction metric via convex optimization, thereby obtaining an explicit exponential bound on the distance between a time-varying target trajectory and solution trajectories perturbed externally due to disturbances and learning errors. The objective of this paper is, therefore, to present a tutorial overview of contraction theory and its advantages in nonlinear stability analysis of deterministic and stochastic systems, with an emphasis on deriving formal robustness and stability guarantees for various learning-based and data-driven automatic control methods. In particular, we provide a detailed review of techniques for finding contraction metrics and associated control and estimation laws using deep neural networks.

Annual Reviews in Control, Preprint Version, Accepted, Oct. 1st

References in corpus (27)

• Spectral Normalization for Generative Adversarial Networks
• Input-to-State Safety With Control Barrier Functions
• Safe Model-based Reinforcement Learning with Stability Guarantees
• A PAC-Bayesian Approach to Spectrally-Normalized Margin Bounds for Neural Networks
• Stable Concurrent Synchronization in Dynamic System Networks
• Stability and Robustness Analysis of Nonlinear Systems via Contraction Metrics and SOS Programming
• Neural Lyapunov Control
• Projection Operator in Adaptive Systems
• GLAS: Global-to-Local Safe Autonomy Synthesis for Multi-Robot Motion Planning with End-to-End Learning
• The Lyapunov Neural Network: Adaptive Stability Certification for Safe Learning of Dynamical Systems
• Neural Contraction Metrics for Robust Estimation and Control: A Convex Optimization Approach
• Robust Controller Design for Stochastic Nonlinear Systems via Convex Optimization
• MPC-Net: A First Principles Guided Policy Search
• Tube-Certified Trajectory Tracking for Nonlinear Systems With Robust Control Contraction Metrics
• Beyond Convexity -- Contraction and Global Convergence of Gradient Descent
• Control Regularization for Reduced Variance Reinforcement Learning
• Learning-based Robust Motion Planning with Guaranteed Stability: A Contraction Theory Approach
• Neural Stochastic Contraction Metrics for Learning-based Control and Estimation
• Data-driven computation of invariant sets of discrete time-invariant black-box systems
• Learning Stability Certificates from Data
• Lipschitz Bounded Equilibrium Networks
• A Comparison of LPV Gain Scheduling and Control Contraction Metrics for Nonlinear Control
• Virtual Control Contraction Metrics: Convex Nonlinear Feedback Design via Behavioral Embedding
• Stochastic Contraction in Riemannian Metrics
• Incremental Nonlinear Stability Analysis of Stochastic Systems Perturbed by Lévy Noise
• Uncertainty-aware Safe Exploratory Planning using Gaussian Process and Neural Control Contraction Metric
• Notes on stable learning with piecewise-linear basis functions

Cited by in corpus (7)

• Non-Euclidean Contraction Analysis of Continuous-Time Neural Networks
• The Yakubovich S-Lemma Revisited: Stability and Contractivity in Non-Euclidean Norms
• Neural-Rendezvous: Provably Robust Guidance and Control to Encounter Interstellar Objects
• Incremental Nonlinear Stability Analysis of Stochastic Systems Perturbed by Lévy Noise
• Interstellar Object Accessibility and Mission Design
• A Multiplex Approach Against Disturbance Propagation in Nonlinear Networks with Delays
• Guaranteed Trajectory Tracking under Learned Dynamics with Contraction Metrics and Disturbance Estimation