Precision As You Need: Stochastic Computing Is a Dense Adaptive Quantizer

Haoran Jin, Kangqi Zhang, Jirong Yang +4

Matrix multiplications dominate the inference cost of modern transformer-based vision models, yet existing efficiency techniques such as post-training quantization and mixed-precis…