Real-Time Machine-Learning-Based Optimization Using Input Convex Long Short-Term Memory Network

Abstract

Neural network-based optimization and control methods, often referred to as black-box approaches, are increasingly gaining attention in energy and manufacturing systems, particularly in situations where first-principles models are either unavailable or inaccurate. However, their non-convex nature significantly slows down the optimization and control processes, limiting their application in real-time decision-making processes. To address this challenge, we propose a novel Input Convex Long Short-Term Memory (IC-LSTM) network to enhance the computational efficiency of neural network-based optimization. Through two case studies employing real-time neural network-based optimization for optimizing energy and chemical systems, we demonstrate the superior performance of IC-LSTM-based optimization in terms of runtime. Specifically, in a real-time optimization problem of a real-world solar photovoltaic energy system at LHT Holdings in Singapore, IC-LSTM-based optimization achieved at least 4-fold speedup compared to conventional LSTM-based optimization. These results highlight the potential of IC-LSTM networks to significantly enhance the efficiency of neural network-based optimization and control in practical applications. Source code is available at https://github.com/killingbear999/ICLSTM.

Applied Energy

References in corpus (9)

• Adam: A Method for Stochastic Optimization
• SciPy 1.0--Fundamental Algorithms for Scientific Computing in Python
• Fundamentals of Recurrent Neural Network (RNN) and Long Short-Term Memory (LSTM) Network
• Physics-informed linear regression is competitive with two Machine Learning methods in residential building MPC
• Input Convex Neural Networks for Building MPC
• Input Convex Neural Networks for Optimal Voltage Regulation
• Optimizing Functionals on the Space of Probabilities with Input Convex Neural Networks
• Principled Weight Initialisation for Input-Convex Neural Networks
• Input Convex Lipschitz Recurrent Neural Networks for Robust and Efficient Process Modeling and Optimization

Cited by in corpus (2)

• Towards Foundation Model for Chemical Reactor Modeling: Meta-Learning with Physics-Informed Adaptation
• An Adaptive Grasping Force Tracking Strategy for Nonlinear and Time-Varying Object Behaviors