A Review of the Gumbel-max Trick and its Extensions for Discrete Stochasticity in Machine Learning

Iris A. M. Huijben, Wouter Kool, Max B. Paulus +1

The Gumbel-max trick is a method to draw a sample from a categorical distribution, given by its unnormalized (log-)probabilities. Over the past years, the machine learning communit…