Discrete Hamilton-Jacobi Theory
arXiv:0911.2258 · doi:10.1137/090776822
Abstract
We develop a discrete analogue of Hamilton-Jacobi theory in the framework of discrete Hamiltonian mechanics. The resulting discrete Hamilton-Jacobi equation is discrete only in time. We describe a discrete analogue of Jacobi's solution and also prove a discrete version of the geometric Hamilton-Jacobi theorem. The theory applied to discrete linear Hamiltonian systems yields the discrete Riccati equation as a special case of the discrete Hamilton-Jacobi equation. We also apply the theory to discrete optimal control problems, and recover some well-known results, such as the Bellman equation (discrete-time HJB equation) of dynamic programming and its relation to the costate variable in the Pontryagin maximum principle. This relationship between the discrete Hamilton-Jacobi equation and Bellman equation is exploited to derive a generalized form of the Bellman equation that has controls at internal stages.
26 pages, 2 figures
References in corpus (3)
Cited by in corpus (14)
- Geometric Hamilton-Jacobi theory for higher-order autonomous systems
- Discrete Schlesinger Transformations, their Hamiltonian Formulation, and Difference Painlevé Equations
- Generating Functionals and Lagrangian PDEs
- Structural aspects of Hamilton-Jacobi theory
- A Hamilton-Jacobi formalism for higher order implicit systems
- On the Geometry of the Hamilton-Jacobi Equation and Generating Functions
- Hamilton-Jacobi theory in multisymplectic classical field theories
- An overview of the Hamilton--Jacobi theory: the classical and geometrical approaches and some extensions and applications
- The geometry of Rayleigh dissipation
- Discrete Hamiltonian Variational Integrators
- Deep Learning: Hydrodynamics, and Lie-Poisson Hamilton-Jacobi Theory
- Lagrangian submanifolds and Hamilton-Jacobi equation
- Geometrical structures of higher-order dynamical systems and field theories
- Geometry of the discrete Hamilton--Jacobi equation. Applications in optimal control