activity
20192021
most citedBatch Group Normalization

10 citations · 18 across the 4 of their papers we have counts for

collaborators

6 papers

cs.LG2021

Towards Understanding the Generative Capability of Adversarially Robust Classifiers

Yao Zhu, Jiacheng Ma, Jiacheng Sun +3

Recently, some works found an interesting phenomenon that adversarially robust classifiers can generate good images comparable to generative models. We investigate this phenomenon…

cs.LG20218 cited

Improved OOD Generalization via Adversarial Training and Pre-training

Mingyang Yi, Lu Hou, Jiacheng Sun +4

Recently, learning a model that generalizes well on out-of-distribution (OOD) data has attracted great attention in the machine learning community. In this paper, after defining OO…

cs.LG202010 cited

Batch Group Normalization

Xiao-Yun Zhou, Jiacheng Sun, Nanyang Ye +6

Deep Convolutional Neural Networks (DCNNs) are hard and time-consuming to train. Normalization is one of the effective solutions. Among previous normalization methods, Batch Normal…

cs.LG2020

A Practical Layer-Parallel Training Algorithm for Residual Networks

Qi Sun, Hexin Dong, Zewei Chen +5

Gradient-based algorithms for training ResNets typically require a forward pass of the input data, followed by back-propagating the objective gradient to update parameters, which a…

cs.LG2020

New Interpretations of Normalization Methods in Deep Learning

Jiacheng Sun, Xiangyong Cao, Hanwen Liang +3

In recent years, a variety of normalization methods have been proposed to help train neural networks, such as batch normalization (BN), layer normalization (LN), weight normalizati…

cs.CV2019

DARTS+: Improved Differentiable Architecture Search with Early Stopping

Hanwen Liang, Shifeng Zhang, Jiacheng Sun +4

Recently, there has been a growing interest in automating the process of neural architecture design, and the Differentiable Architecture Search (DARTS) method makes the process ava…