Improving Discrete Latent Representations With Differentiable Approximation Bridges

Jason Ramapuram, Russ Webb

Modern neural network training relies on piece-wise (sub-)differentiable functions in order to use backpropagation to update model parameters. In this work, we introduce a novel me…