90 citations · 162 across the 13 of their papers we have counts for
4 papers · 1 filter
FIXED: Frustratingly Easy Domain Generalization with Mixup
Wang Lu, Jindong Wang, Han Yu +4
Domain generalization (DG) aims to learn a generalizable model from multiple training domains such that it can perform well on unseen target domains. A popular strategy is to augme…
Understanding the Failure of Batch Normalization for Transformers in NLP
Jiaxi Wang, Ji Wu, Lei Huang
Batch Normalization (BN) is a core and prevalent technique in accelerating the training of deep neural networks and improving the generalization on Computer Vision (CV) tasks. Howe…
Bi-level Doubly Variational Learning for Energy-based Latent Variable Models
Ge Kan, Jinhu Lü, Tian Wang +5
Energy-based latent variable models (EBLVMs) are more expressive than conventional energy-based models. However, its potential on visual tasks are limited by its training process b…
Delving into the Estimation Shift of Batch Normalization in a Network
Lei Huang, Yi Zhou, Tian Wang +2
Batch normalization (BN) is a milestone technique in deep learning. It normalizes the activation using mini-batch statistics during training but the estimated population statistics…