RATQ: A Universal Fixed-Length Quantizer for Stochastic Optimization

Prathamesh Mayekar, Himanshu Tyagi

We present Rotated Adaptive Tetra-iterated Quantizer (RATQ), a fixed-length quantizer for gradients in first order stochastic optimization. RATQ is easy to implement and involves o…