Towards Accurate and Efficient Sub-8-Bit Integer Training

Wenjin Guo, Donglai Liu, Weiying Xie +7

Neural network training is a memory- and compute-intensive task. Quantization, which enables low-bitwidth formats in training, can significantly mitigate the workload. To reduce qu…