Online learning-based Model Predictive Control with Gaussian Process Models and Stability Guarantees

Abstract

Model predictive control allows to provide high performance and safety guarantees in the form of constraint satisfaction. These properties, however, can be satisfied only if the underlying model, used for prediction, of the controlled process is sufficiently accurate. One way to address this challenge is by data-driven and machine learning approaches, such as Gaussian processes, that allow to refine the model online during operation. We present a combination of an output feedback model predictive control scheme and a Gaussian process-based prediction model that is capable of efficient online learning. To this end, the concept of evolving Gaussian processes is combined with recursive posterior prediction updates. The presented approach guarantees recursive constraint satisfaction and input-to-state stability with respect to the model-plant mismatch. Simulation studies underline that the Gaussian process prediction model can be successfully and efficiently learned online. The resulting computational load is significantly reduced via the combination of the recursive update procedure and by limiting the number of training data points while maintaining good performance.

29 pages, 13 figures, 3 tables, 1 algorithm, revision submitted to International Journal of Robust and Nonlinear Control

References in corpus (8)

• Gaussian Process Optimization in the Bandit Setting: No Regret and Experimental Design
• Monte Carlo Implementation of Gaussian Process Models for Bayesian Regression and Classification
• Safe Model-based Reinforcement Learning with Stability Guarantees
• Safe Learning of Regions of Attraction for Uncertain, Nonlinear Systems with Gaussian Processes
• Cautious NMPC with Gaussian Process Dynamics for Autonomous Miniature Race Cars
• Gaussian Processes for Nonlinear Signal Processing
• Learning-based Model Predictive Control for Safe Exploration and Reinforcement Learning
• Gaussian Process-Based Model Predictive Control of Blood Glucose for Patients with Type 1 Diabetes Mellitus

Cited by in corpus (6)

• Exploring the Links between the Fundamental Lemma and Kernel Regression
• Combining Robust Control and Machine Learning for Uncertain Nonlinear Systems Subject to Persistent Disturbances
• Learning Agent-based Model Predictive Control for Holistic Vehicle Performance
• Learning-Based Optimal Control with Performance Guarantees for Unknown Systems with Latent States
• Learning-based Event-triggered MPC with Gaussian processes under terminal constraints
• A robust and adaptive MPC formulation for Gaussian process models