A zero-sum game between a singular stochastic controller and a discretionary stopper

Abstract

We consider a stochastic differential equation that is controlled by means of an additive finite-variation process. A singular stochastic controller, who is a minimizer, determines this finite-variation process, while a discretionary stopper, who is a maximizer, chooses a stopping time at which the game terminates. We consider two closely related games that are differentiated by whether the controller or the stopper has a first-move advantage. The games' performance indices involve a running payoff as well as a terminal payoff and penalize control effort expenditure. We derive a set of variational inequalities that can fully characterize the games' value functions as well as yield Markovian optimal strategies. In particular, we derive the explicit solutions to two special cases and we show that, in general, the games' value functions fail to be $C^1$. The nonuniqueness of the optimal strategy is an interesting feature of the game in which the controller has the first-move advantage.

Published in at http://dx.doi.org/10.1214/13-AAP986 the Annals of Applied Probability (http://www.imstat.org/aap/) by the Institute of Mathematical Statistics (http://www.imstat.org)

References in corpus (2)

• Martingale approach to stochastic differential games of control and stopping
• On the Optimal Stopping of a One-dimensional Diffusion

Cited by in corpus (1)

• Game theory models for communication between agents: a review