MicroQonv: Reshaping Convolution Tensors for Efficient Microscaling in Training and Inference

Romain Facq, Sami Ben Ali, Olivier Sentieys

Microscaling quantization techniques are increasingly used to represent neural network parameters with 8 bits or fewer while preserving near-full precision accuracy. However, apply…