FP8 versus INT8 for efficient deep learning inference

Mart van Baalen, Andrey Kuzmin, Suparna S Nair +8

Recently, the idea of using FP8 as a number format for neural network training has been floating around the deep learning world. Given that most training is currently conducted wit…