activity
20172022
most citedVisualizing the Loss Landscape of Neural Nets

605 citations · 919 across the 15 of their papers we have counts for

collaborators
Showing 2020Show all

7 papers · 1 filter

cs.LG2020★ 13 cited

WeMix: How to Better Utilize Data Augmentation

Yi Xu, Asaf Noy, Ming Lin +3

Data augmentation is a widely used training trick in deep learning to improve the network generalization ability. Despite many encouraging results, several recent studies did point…

eess.IV2020★ 35 cited

Learning Accurate Entropy Model with Global Reference for Image Compression

Yichen Qian, Zhiyu Tan, Xiuyu Sun +5

In recent deep image compression neural networks, the entropy model plays a critical role in estimating the prior distribution of deep image encodings. Existing methods combine hyp…

cs.CV2020★ 2 cited

Semi-Anchored Detector for One-Stage Object Detection

Lei Chen, Qi Qian, Hao Li

A standard one-stage detector is comprised of two tasks: classification and regression. Anchors of different shapes are introduced for each location in the feature map to mitigate…

cs.LG2020

Improved Knowledge Distillation via Full Kernel Matrix Transfer

Qi Qian, Hao Li, Juhua Hu

Knowledge distillation is an effective way for model compression in deep learning. Given a large model (i.e., teacher model), it aims to improve the performance of a compact model…

cs.CV2020★ 11 cited

Neural Architecture Design for GPU-Efficient Networks

Ming Lin, Hesen Chen, Xiuyu Sun +3

Many mission-critical systems are based on GPU for inference. It requires not only high recognition accuracy but also low latency in responding time. Although many studies are devo…

cs.LG2020★ 28 cited

Towards Understanding Label Smoothing

Yi Xu, Yuanhong Xu, Qi Qian +2

Label smoothing regularization (LSR) has a great success in training deep neural networks by stochastic algorithms such as stochastic gradient descent and its variants. However, th…