80 citations · 173 across the 18 of their papers we have counts for
16 papers · 1 filter
Optimality of delayed reward attainment under uncertainty
Chuwei Wang, Alexander Vladimirsky, Anastasia Bizyaeva
Decision making under uncertainty requires balancing the value of additional information against the cost of delaying the decision until that information becomes available. This ch…
Risk-aware stochastic control of a sailboat
MingYi Wang, Natasha Patnaik, Anne Somalwar +2
Sailboat path-planning is a natural hybrid control problem (due to continuous steering and occasional "tack-switching" maneuvers), with the actual path-to-target greatly affected b…
Optimal Driving Under Traffic Signal Uncertainty
Mallory E. Gaspard, Alexander Vladimirsky
We study driver's optimal trajectory planning under uncertainty in the duration of a traffic light's green phase. We interpret this as an optimal control problem with an objective…
Stochastic Optimal Control of a Sailboat
Cole Miles, Alexander Vladimirsky
In match race sailing, competitors must steer their boats upwind in the presence of unpredictably evolving weather. Combined with the tacking motion necessary to make upwind progre…
Optimal Path-Planning with Random Breakdowns
Marissa Gee, Alexander Vladimirsky
We propose a model for path-planning based on a single performance metric that accurately accounts for the the potential (spatially inhomogeneous) cost of breakdowns and repairs. T…
Optimality and robustness in path-planning under initial uncertainty
Dongping Qi, Adam Dhillon, Alexander Vladimirsky
Classical deterministic optimal control problems assume full information about the controlled process. The theory of control for general partially-observable processes is powerful,…
Quantifying and managing uncertainty in piecewise-deterministic Markov processes
Elliot Cartee, Antonio Farah, April Nellis +2
In piecewise-deterministic Markov processes (PDMPs) the state of a finite-dimensional system evolves continuously, but the evolutive equation may change randomly as a result of dis…
Control-Theoretic Models of Environmental Crime
Elliot Cartee, Alexander Vladimirsky
We present two models of perpetrators' decision-making in extracting resources from a protected area. It is assumed that the authorities conduct surveillance to counter the extract…
Time-Dependent Surveillance-Evasion Games
Elliot Cartee, Lexiao Lai, Qianli Song +1
Surveillance-Evasion (SE) games form an important class of adversarial trajectory-planning problems. We consider time-dependent SE games, in which an Evader is trying to reach its…
Evasive path planning under surveillance uncertainty
Marc Aurèle Gilles, Alexander Vladimirsky
The classical setting of optimal control theory assumes full knowledge of the process dynamics and the costs associated with every control strategy. The problem becomes much harder…
Anisotropic Challenges in Pedestrian Flow Modeling
Elliot Cartee, Alexander Vladimirsky
Macroscopic models of crowd flow incorporating individual pedestrian choices present many analytic and computational challenges. Anisotropic interactions are particularly subtle, b…
Piecewise-Deterministic Optimal Path Planning
Zhengdi Shen, Alexander Vladimirsky
We consider piecewise-deterministic optimal control problems in which the environment randomly switches among several deterministic modes, and the goal is to optimize the expected…
Deterministic control of randomly-terminated processes
June Andrews, Alexander Vladimirsky
We consider both discrete and continuous "uncertain horizon" deterministic control processes, for which the termination time is a random variable. We examine the dynamic programmin…
Optimal control with reset-renewable resources
Ryo Takei, Weiyan Chen, Zachary Clawson +2
We consider both discrete and continuous control problems constrained by a fixed budget of some resource, which may be renewed upon entering a preferred subset of the state space.…
An efficient method for multiobjective optimal control and optimal control subject to integral constraints
Ajeet Kumar, Alexander Vladimirsky
We introduce a new and efficient numerical method for multicriterion optimal control and single criterion optimal control under integral constraints. The approach is based on exten…
Label-setting methods for Multimode Stochastic Shortest Path problems on graphs
Alexander Vladimirsky
Stochastic shortest path (SSP) problems arise in a variety of discrete stochastic control contexts. An optimal solutions to such a problem is typically computed using the value fun…