Rao-Blackwellized Stochastic Gradients for Discrete Distributions

Runjing Liu, Jeffrey Regier, Nilesh Tripuraneni +2

We wish to compute the gradient of an expectation over a finite or countably infinite sample space having $K\le \infty$ categories. When $K$ is indeed infinite, or finite but ver…