257 citations · 963 across the 48 of their papers we have counts for
4 papers · 1 filter
KNAS: Green Neural Architecture Search
Jingjing Xu, Liang Zhao, Junyang Lin +3
Many existing neural architecture search (NAS) solutions rely on downstream training for architecture evaluation, which takes enormous computations. Considering that these computat…
A Survey on Green Deep Learning
Jingjing Xu, Wangchunshu Zhou, Zhiyi Fu +2
In recent years, larger and deeper models are springing up and continuously pushing state-of-the-art (SOTA) results across various fields like natural language processing (NLP) and…
Understanding and Improving Layer Normalization
Jingjing Xu, Xu Sun, Zhiyuan Zhang +2
Layer normalization (LayerNorm) is a technique to normalize the distributions of intermediate layers. It enables smoother gradients, faster training, and better generalization accu…
Minimal Effort Back Propagation for Convolutional Neural Networks
Bingzhen Wei, Xu Sun, Xuancheng Ren +1
As traditional neural network consumes a significant amount of computing resources during back propagation, \citet{Sun2017mePropSB} propose a simple yet effective technique to alle…