A Survey of Contextual Optimization Methods for Decision Making under Uncertainty

Abstract

Recently there has been a surge of interest in operations research (OR) and the machine learning (ML) community in combining prediction algorithms and optimization techniques to solve decision-making problems in the face of uncertainty. This gave rise to the field of contextual optimization, under which data-driven procedures are developed to prescribe actions to the decision-maker that make the best use of the most recently updated information. A large variety of models and methods have been presented in both OR and ML literature under a variety of names, including data-driven optimization, prescriptive optimization, predictive stochastic programming, policy optimization, (smart) predict/estimate-then-optimize, decision-focused learning, (task-based) end-to-end learning/forecasting/optimization, etc. Focusing on single and two-stage stochastic programming problems, this review article identifies three main frameworks for learning policies from data and discusses their strengths and limitations. We present the existing models and methods under a uniform notation and terminology and classify them according to the three main frameworks identified. Our objective with this survey is to both strengthen the general understanding of this active field of research and stimulate further theoretical and algorithmic advancements in integrating ML and stochastic programming.

References in corpus (29)

• Towards A Rigorous Science of Interpretable Machine Learning
• Kernel methods in machine learning
• Deep Equilibrium Models
• Decision-Focused Learning: Foundations, State of the Art, Benchmark and Future Opportunities
• Generalized Inner Loop Meta-Learning
• Theseus: A Library for Differentiable Nonlinear Optimization
• Learning with Differentiable Perturbed Optimizers
• Interior Point Solving for LP-based prediction+optimisation
• Data-Driven Sample Average Approximation with Covariate Information
• Nonsmooth Implicit Differentiation for Machine Learning and Optimization
• Enforcing robust control guarantees within neural network policies
• Backpropagation through Combinatorial Algorithms: Identity with Projection Works
• Inverse Optimization: Theory and Applications
• Distributionally Robust Local Non-parametric Conditional Estimation
• Integrated Conditional Estimation-Optimization
• Robustifying Conditional Portfolio Decisions via Optimal Transport
• Residuals-based distributionally robust optimization with covariate information
• End-to-End Stochastic Optimization with Energy-Based Model
• Decision-Aware Learning for Optimizing Health Supply Chains
• Active Learning For Contextual Linear Optimization: A Margin-Based Approach
• End-to-End Learning for Stochastic Optimization: A Bayesian Perspective
• A Note on Task-Aware Loss via Reweighing Prediction Loss by Decision-Regret
• TorchOpt: An Efficient Library for Differentiable Optimization
• Bilevel Optimization for Feature Selection in the Data-Driven Newsvendor Problem
• Learning with Combinatorial Optimization Layers: a Probabilistic Approach
• Conformal Contextual Robust Optimization
• Distributionally Robust Prescriptive Analytics with Wasserstein Distance
• Solving Data-Driven Newsvendor Pricing Problems with Decision-Dependent Effect
• Optimizer's Information Criterion: Dissecting and Correcting Bias in Data-Driven Optimization

Cited by in corpus (8)

• Decision-Focused Learning: Foundations, State of the Art, Benchmark and Future Opportunities
• Towards a Systems Theory of Algorithms
• Decision-Oriented Learning for Future Power System Decision-Making under Uncertainty
• Contextual Stochastic Optimization for Omnichannel Multi-Courier Order Fulfillment Under Delivery Time Uncertainty
• An Improved FOX Optimization Algorithm Using Adaptive Exploration and Exploitation for Global Optimization
• Learn to Bid as a Price-Maker Wind Power Producer
• A Capacitated Collection-and-Delivery-Point Location Problem with Random Utility Maximizing Customers
• A kernel-based stochastic approximation framework for contextual optimization