Direction-Preserving Number Representations

Bardia Zadeh, George A. Constantinides

Low-precision number formats are widely used in modern machine learning systems due to their efficiency. Accurate direction representation is key to the accuracy of vector operatio…