Training Discrete Deep Generative Models via Gapped Straight-Through Estimator

Ting-Han Fan, Ta-Chung Chi, Alexander I. Rudnicky +1

While deep generative models have succeeded in image processing, natural language processing, and reinforcement learning, training that involves discrete random variables remains c…