3 citations · 4 across the 10 of their papers we have counts for
4 papers · 1 filter
Dynamic Programming: From Local Optimality to Global Optimality
John Stachurski, Jingni Yang, Ziyue Yang
In the theory of dynamic programming, an optimal policy is a policy whose lifetime value dominates that of all other policies from every possible initial condition in the state spa…
Dynamic Programs on Partially Ordered Sets
Thomas J. Sargent, John Stachurski
We introduce a framework that represents a dynamic program as a family of operators acting on a partially ordered set. We provide an optimality theory based only on order-theoretic…
Dynamic Programming Deconstructed: Transformations of the Bellman Equation and Computational Efficiency
Qingyin Ma, John Stachurski
Some approaches to solving challenging dynamic programming problems, such as Q-learning, begin by transforming the Bellman equation into an alternative functional equation, in orde…
Optimal Timing of Decisions: A General Theory Based on Continuation Values
Qingyin Ma, John Stachurski
Building on insights of Jovanovic (1982) and subsequent authors, we develop a comprehensive theory of optimal timing of decisions based around continuation value functions and oper…