activity
20192021
most citedNormalization Techniques in Training DNNs: Methodology, Analysis and Application

52 citations · 87 across the 6 of their papers we have counts for

collaborators
Showing 2020Show all

6 papers · 1 filter

cs.LG2020★ 2 cited

Slimmable Generative Adversarial Networks

Liang Hou, Zehuan Yuan, Lei Huang +3

Generative adversarial networks (GANs) have achieved remarkable progress in recent years, but the continuously growing scale of models makes them challenging to deploy widely in pr…

cs.LG2020★ 52 cited

Normalization Techniques in Training DNNs: Methodology, Analysis and Application

Lei Huang, Jie Qin, Yi Zhou +3

Normalization techniques are essential for accelerating the training and improving the generalization of deep neural networks (DNNs), and have successfully been used in various app…

cs.LG2020

Group Whitening: Balancing Learning Efficiency and Representational Capacity

Lei Huang, Yi Zhou, Li Liu +2

Batch normalization (BN) is an important technique commonly incorporated into deep learning models to perform standardization within mini-batches. The merits of BN in improving a m…

cs.CV2020

A Benchmark for Studying Diabetic Retinopathy: Segmentation, Grading, and Transferability

Yi Zhou, Boyang Wang, Lei Huang +2

People with diabetes are at risk of developing an eye disease called diabetic retinopathy (DR). This disease occurs when high blood glucose levels cause damage to blood vessels in…

cs.LG2020★ 3 cited

Invertible Zero-Shot Recognition Flows

Yuming Shen, Jie Qin, Lei Huang

Deep generative models have been successfully applied to Zero-Shot Learning (ZSL) recently. However, the underlying drawbacks of GANs and VAEs (e.g., the hardness of training with…

cs.LG2020★ 25 cited

On the Number of Linear Regions of Convolutional Neural Networks

H. Xiong, L. Huang, M. Yu +3

One fundamental problem in deep learning is understanding the outstanding performance of deep Neural Networks (NNs) in practice. One explanation for the superiority of NNs is that…