A Metric Driven Approach to Mixed Precision Training

Mitchelle Rasquinha, Gil Tabak

As deep learning methodologies have developed, it has been generally agreed that increasing neural network size improves model quality. However, this is at the expense of memory an…