Error Diffusion: Post Training Quantization with Block-Scaled Number Formats for Neural Networks

Alireza Khodamoradi, Kristof Denolf, Eric Dellinger

Quantization reduces the model's hardware costs, such as data movement, storage, and operations like multiply and addition. It also affects the model's behavior by degrading the ou…