Optimization under Uncertainty in the Era of Big Data and Deep Learning: When Machine Learning Meets Mathematical Programming

Abstract

This paper reviews recent advances in the field of optimization under uncertainty via a modern data lens, highlights key research challenges and promise of data-driven optimization that organically integrates machine learning and mathematical programming for decision-making under uncertainty, and identifies potential research opportunities. A brief review of classical mathematical programming techniques for hedging against uncertainty is first presented, along with their wide spectrum of applications in Process Systems Engineering. A comprehensive review and classification of the relevant publications on data-driven distributionally robust optimization, data-driven chance constrained program, data-driven robust optimization, and data-driven scenario-based optimization is then presented. This paper also identifies fertile avenues for future research that focuses on a closed-loop data-driven optimization framework, which allows the feedback from mathematical programming to machine learning, as well as scenario-based optimization leveraging the power of deep learning techniques. Perspectives on online learning-based data-driven multistage optimization with a learning-while-optimizing scheme is presented.

References in corpus (10)

• Conic Programming Reformulations of Two-Stage Distributionally Robust Linear Programs over Wasserstein Balls
• Performance Bounds for the Scenario Approach and an Extension to a Class of Non-convex Programs
• A data-driven robust optimization approach to scenario-based stochastic model predictive control
• Data-Driven Stochastic Robust Optimization: A General Computational Framework and Algorithm for Optimization under Uncertainty in the Big Data Era
• Distributionally Robust Stochastic Optimization with Wasserstein Distance
• On the Sample Size of Random Convex Programs with Structured Dependence on the Uncertainty (Extended Version)
• Ambiguous Chance-Constrained Binary Programs under Mean-Covariance Information
• Sequential Randomized Algorithms for Convex Optimization in the Presence of Uncertainty
• Data-Driven Chance Constrained Programs over Wasserstein Balls
• Distributionally robust polynomial chance-constraints under mixture ambiguity sets

Cited by in corpus (17)

• A Review of Uncertainty Quantification in Deep Learning: Techniques, Applications and Challenges
• Deep Learning and Knowledge-Based Methods for Computer Aided Molecular Design -- Toward a Unified Approach: State-of-the-Art and Future Directions
• Maximizing information from chemical engineering data sets: Applications to machine learning
• Quantum Computing Assisted Deep Learning for Fault Detection and Diagnosis in Industrial Process Systems
• Generative AI and Process Systems Engineering: The Next Frontier
• Online Learning Based Risk-Averse Stochastic MPC of Constrained Linear Uncertain Systems
• Look Before You Leap: An Exploratory Study of Uncertainty Measurement for Large Language Models
• Network-Aware Flexibility Requests for Distribution-Level Flexibility Markets
• Distributionally Robust Chance Constrained Programming with Generative Adversarial Networks (GANs)
• Adaptive Learning for the Resource-Constrained Classification Problem
• Plant-wide byproduct gas distribution under uncertainty in iron and steel industry via quantile forecasting and robust optimization
• Quantifying the structure of strong gravitational lens potentials with uncertainty-aware deep neural networks
• Convergence Certificate for Stochastic Derivative-Free Trust-Region Methods based on Gaussian Processes
• A Two-Stage Stochastic Programming Model for Car-Sharing Problem using Kernel Density Estimation
• Electric Vehicle Charging Scheduling in Green Logistics: Challenges, Approaches and Opportunities
• Learning MDPs from Features: Predict-Then-Optimize for Sequential Decision Problems by Reinforcement Learning
• Grover Adaptive Search with Spin Variables