MGS: Markov Greedy Sums for Accurate Low-Bitwidth Floating-Point Accumulation

Vikas Natesh, H. T. Kung, David Kong

We offer a novel approach, MGS (Markov Greedy Sums), to improve the accuracy of low-bitwidth floating-point dot products in neural network computations. In conventional 32-bit floa…