Optimization of GNN Training Through Half-precision

Arnab Kanti Tarafder, Yidong Gong, Pradeep Kumar

Recent trends in lower precision, e.g. half-precision floating point, training have shown improved system performance and reduced memory usage for Deep Learning while maintaining a…