Training Non-Differentiable Networks via Optimal Transport

An T. Le

Hard thresholds, quantization, and discrete routing can produce training losses with flat regions and jumps, where ordinary gradients vanish or are undefined. We introduce PolyStep…