HJB and Fokker-Planck equations for river environmental management based on stochastic impulse control with discrete and random observation

Abstract

We formulate a new two-variable river environmental restoration problem based on jump stochastic differential equations (SDEs) governing the sediment storage and nuisance benthic algae population dynamics in a dam-downstream river. Controlling the dynamics is carried out through impulsive sediment replenishment with discrete and random observation/intervention to avoid sediment depletion and thick algae growth. We consider a cost-efficient management problem of the SDEs to achieve the objectives whose resolution reduces to solving a Hamilton-Jacobi-Bellman (HJB) equation. We also consider a Fokker-Planck (FP) equation governing the probability density function of the controlled dynamics. The HJB equation has a discontinuous solution, while the FP equation has a Dirac's delta along boundaries. We show that the value function, the optimized objective function, is governed by the HJB equation in the simplified case and further that a threshold-type control is optimal. We demonstrate that simple numerical schemes can handle these equations. Finally, we numerically analyze the optimal controls and the resulting probability density functions.

Accepted manuscript

References in corpus (5)

• Stochastic Resetting and Applications
• Marcus versus Stratonovich for Systems with Jump Noise
• On Lagrangian schemes for porous medium type generalized diffusion equations: a discrete energetic variational approach
• River environmental restoration based on random observations of a non-smooth stochastic dynamical system
• A random observation-based management model of population dynamics and its ecological application

Cited by in corpus (3)

• Hamilton-Jacobi-Bellman-Isaacs equation for rational inattention in the long-run management of river environments under uncertainty
• Analytical and numerical solutions to ergodic control problems arising in environmental management
• Modeling and computation of an integral operator Riccati equation for an infinite-dimensional stochastic differential equation governing streamflow discharge