Gradient Estimation via Differentiable Metropolis-Hastings

Gaurav Arya, Moritz Schauer, Ruben Seyer

Metropolis-Hastings estimates intractable expectations - can differentiating the algorithm estimate their gradients? The challenge is that Metropolis-Hastings trajectories are not…