Beyond Discreteness: Sample Complexity Analysis of Straight-Through Estimator for 1-bit Quantization

Halyun Jeong, Jack Xin, Penghang Yin

Training quantized neural networks requires addressing the non-differentiable and discrete nature of the underlying optimization problem. To tackle this challenge, the straight-thr…