Global Deterministic Optimization with Artificial Neural Networks Embedded

Abstract

Artificial neural networks (ANNs) are used in various applications for data-driven black-box modeling and subsequent optimization. Herein, we present an efficient method for deterministic global optimization of ANN embedded optimization problems. The proposed method is based on relaxations of algorithms using McCormick relaxations in a reduced-space [\textit{SIOPT}, 20 (2009), pp. 573-601] including the convex and concave envelopes of the nonlinear activation function of ANNs. The optimization problem is solved using our in-house global deterministic solver MAiNGO. The performance of the proposed method is shown in four optimization examples: an illustrative function, a fermentation process, a compressor plant and a chemical process optimization. The results show that computational solution time is favorable compared to the global general-purpose optimization solver BARON.

J Optim Theory Appl (2018)

Cited by in corpus (15)

• ReLU Networks as Surrogate Models in Mixed-Integer Linear Programs
• Maximizing information from chemical engineering data sets: Applications to machine learning
• Machine learning for industrial sensing and control: A survey and practical perspective
• Multi-scale membrane process optimization with high-fidelity ion transport models through machine learning
• Learning from flowsheets: A generative transformer model for autocompletion of flowsheets
• Obey validity limits of data-driven models
• ENTMOOT: A Framework for Optimization over Ensemble Tree Models
• Bayesian Approach to Probabilistic Design Space Characterization: A Nested Sampling Strategy
• Global Optimization of Gaussian processes
• Modern Machine Learning Tools for Monitoring and Control of Industrial Processes: A Survey
• Graph Machine Learning for Design of High-Octane Fuels
• A physics-informed Bayesian optimization method for rapid development of electrical machines
• Optimal training of integer-valued neural networks with mixed integer programming
• A Comparison of Strategies to Embed Physics-Informed Neural Networks in Nonlinear Model Predictive Control Formulations Solved via Direct Transcription
• Superstructure Optimization with Embedded Neural Networks for Sustainable Aviation Fuel Production