A Zero-Sum Stochastic Game with Compact Action Sets and no Asymptotic Value

Abstract

We give an example of a zero-sum stochastic game with four states, compact action sets for each player, and continuous payoff and transition functions, such that the discounted value does not converge as the discount factor tends to 0, and the value of the n-stage game does not converge as n goes to infinity.

Cited by in corpus (10)

• Definable zero-sum stochastic games
• A formula for the value of a stochastic game
• Convergence of the solutions of the discounted Hamilton-Jacobi equation: a counterexample
• Tauberian theorem for value functions
• Commutative Stochastic Games
• Tauberian theorems for general iterations of operators: applications to zero-sum stochastic games
• Operator approach to values of stochastic games with varying stage duration
• Constant payoff in zero-sum stochastic games
• Communicating Zero-Sum Product Stochastic Games
• Hypergraph conditions for the solvability of the ergodic equation for zero-sum games