eXmY: A Data Type and Technique for Arbitrary Bit Precision Quantization

Aditya Agrawal, Matthew Hedlund, Blake Hechtman

eXmY is a novel data type for quantization of ML models. It supports both arbitrary bit widths and arbitrary integer and floating point formats. For example, it seamlessly supports…