LightNorm: Area and Energy-Efficient Batch Normalization Hardware for On-Device DNN Training

Seock-Hwan Noh, Junsang Park, Dahoon Park +3

When training early-stage deep neural networks (DNNs), generating intermediate features via convolution or linear layers occupied most of the execution time. Accordingly, extensive…