Unbiased Estimation of the Hessian for Partially Observed Diffusions
arXiv:2109.02371 · doi:10.1098/rspa.2021.0710
Abstract
In this article we consider the development of unbiased estimators of the Hessian, of the log-likelihood function with respect to parameters, for partially observed diffusion processes. These processes arise in numerous applications, where such diffusions require derivative information, either through the Jacobian or Hessian matrix. As time-discretizations of diffusions induce a bias, we provide an unbiased estimator of the Hessian. This is based on using Girsanov's Theorem and randomization schemes developed through Mcleish [2011] and Rhee & Glynn [2015]. We demonstrate our developed estimator of the Hessian is unbiased, and one of finite variance. We numerically test and verify this by comparing the methodology here to that of a newly proposed particle filtering methodology. We test this on a range of diffusion models, which include different Ornstein--Uhlenbeck processes and the Fitzhugh--Nagumo model, arising in neuroscience.
References in corpus (7)
- Exact simulation of diffusions
- Guided proposals for simulating multi-dimensional diffusion bridges
- Second-Order Stochastic Optimization for Machine Learning in Linear Time
- Exact Simulation for Multivariate Itô Diffusions
- Simulation of elliptic and hypo-elliptic conditional diffusions
- Bayesian estimation of incompletely observed diffusions
- On Unbiased Score Estimation for Partially Observed Diffusions