Efficient Post-training Quantization with FP8 Formats

Haihao Shen, Naveen Mellempudi, Xin He +3

Recent advances in deep learning methods such as LLMs and Diffusion models have created a need for improved quantization methods that can meet the computational demands of these mo…