476 citations
Counting papers with at most 25 authors, so collaboration author lists do not stand in for the people here.
- Australian National UniversityAU4 papers
- Tianjin UniversityCN4 papers
- Tsinghua UniversityCN4 papers
- University of California San DiegoUS4 papers
- Chinese Academy of SciencesCN3 papers
- Institute of Applied Physics and Computational MathematicsCN3 papers
- Beijing Technology and Business UniversityCN2 papers
- Fuzhou UniversityCN2 papers
- Hainan UniversityCN2 papers
- Hohai UniversityCN2 papers
- Inner Mongolia UniversityCN2 papers
- Institute of Theoretical PhysicsCN2 papers
3 papers · 1 filter
Unbounded Dynamic Programming via the Q-Transform
Qingyin Ma, John Stachurski, Alexis Akira Toda
We propose a new approach to solving dynamic decision problems with unbounded rewards based on the transformations used in Q-learning. In our case, the objective of the transform i…
Dynamic Programming Deconstructed: Transformations of the Bellman Equation and Computational Efficiency
Qingyin Ma, John Stachurski
Some approaches to solving challenging dynamic programming problems, such as Q-learning, begin by transforming the Bellman equation into an alternative functional equation, in orde…
Optimal Timing of Decisions: A General Theory Based on Continuation Values
Qingyin Ma, John Stachurski
Building on insights of Jovanovic (1982) and subsequent authors, we develop a comprehensive theory of optimal timing of decisions based around continuation value functions and oper…