Deep Model Predictive Control with Stability Guarantees

Abstract

This paper presents a deep learning based model predictive control algorithm for control affine nonlinear discrete time systems with matched and bounded state dependent uncertainties of unknown structure. Since the structure of uncertainties is not known, a deep learning based adaptive mechanism is utilized to mitigate disturbances. In order to avoid any unwanted behavior during the learning phase, a tube based model predictive controller is employed, which ensures satisfaction of constraints and input-to-state stability of the closed-loop states. In addition, the proposed approach guarantees the convergence of states to origin under certain verifiable conditions. To ensure stability and undesirable learning transients, a dual-timescale adaptation mechanism is proposed, where the weights of the last layer of the neural network are updated each time instant while the inner layers are trained on a slower timescale using training data collected online and selectively stored in a buffer on the basis of singular value maximization criterion. Our results are validated through numerical experiments on wing-rock dynamics. These results indicate that the proposed deep-MPC architecture is effective in learning to control safety critical systems without suffering instability drawbacks.

arXiv commentsubmitted to IEEE

References in corpus (13)

• End to End Learning for Self-Driving Cars
• End-to-End Training of Deep Visuomotor Policies
• Learning an Approximate Model Predictive Controller with Guarantees
• Safe and Fast Tracking on a Robot Manipulator: Robust MPC and Neural Network Control
• Deep Model Predictive Control with Online Learning for Complex Physical Systems
• Learned Visual Navigation for Under-Canopy Agricultural Robots
• Guaranteeing Safety for Neural Network-Based Aircraft Collision Avoidance Systems
• Active Learning of Discrete-Time Dynamics for Uncertainty-Aware Model Predictive Control
• Robust constrained nonlinear Model Predictive Control with Gated Recurrent Unit model -- Extended version
• Robust offset-free constrained Model Predictive Control with Long Short-Term Memory Networks -- Extended version
• CropNav: a Framework for Autonomous Navigation in Real Farms
• Unmatched uncertainty mitigation through neural network supported model predictive control
• Centralized model predictive control with distributed adaptation

Cited by in corpus (1)

• Physics-informed sparse identification-based tube model predictive control for aerial vehicles