A Comparison of Strategies to Embed Physics-Informed Neural Networks in Nonlinear Model Predictive Control Formulations Solved via Direct Transcription

Abstract

This study aims to benchmark candidate strategies for embedding neural network (NN) surrogates in nonlinear model predictive control (NMPC) formulations that are subject to systems described with partial differential equations and that are solved via direct transcription (i.e., simultaneous methods). This study focuses on the use of physics-informed NNs and physics-informed convolutional NNs as the internal (surrogate) models within the NMPC formulation. One strategy embeds NN models as explicit algebraic constraints, leveraging the automatic differentiation (AD) of an algebraic modelling language (AML) to evaluate the derivatives. Alternatively, the solver can be provided with derivatives computed external to the AML via the AD routines of the machine learning environment the NN is trained in. The three numerical experiments considered in this work reveal that replacing mechanistic models with NN surrogates may not always offer computational advantages when smooth activation functions are used in conjunction with a local nonlinear solver (e.g., Ipopt), even with highly nonlinear systems. Moreover, in this context, the external function evaluation of the NN surrogates often outperforms the embedding strategies that rely on explicit algebraic constraints, likely due to the difficulty in initializing the auxiliary variables and constraints introduced by explicit algebraic reformulations.

References in corpus (11)

• SciPy 1.0--Fundamental Algorithms for Scientific Computing in Python
• The GOOSE Dataset for Perception in Unstructured Environments
• Physics Informed Neural Networks for Control Oriented Thermal Modeling of Buildings
• Global Deterministic Optimization with Artificial Neural Networks Embedded
• Physics-Informed Machine Learning: A Survey on Problems, Methods and Applications
• A shooting algorithm for problems with singular arcs
• Convolutional Neural Nets in Chemical Engineering: Foundations, Computations, and Applications
• Accelerating Optimal Power Flow with GPUs: SIMD Abstraction of Nonlinear Programs and Condensed-Space Interior-Point Methods
• Optimal Control Via Neural Networks: A Convex Approach
• Partition-based formulations for mixed-integer optimization of trained ReLU neural networks
• PySCIPOpt-ML: Embedding Trained Machine Learning Models into Mixed-Integer Programs