24 citations · 46 across the 7 of their papers we have counts for
3 papers · 1 filter
Alignment Attention by Matching Key and Query Distributions
Shujian Zhang, Xinjie Fan, Huangjie Zheng +2
The neural attention mechanism has been incorporated into deep neural networks to achieve state-of-the-art performance in various domains. Most such models use multi-head self-atte…
A Prototype-Oriented Framework for Unsupervised Domain Adaptation
Korawat Tanwisuth, Xinjie Fan, Huangjie Zheng +4
Existing methods for unsupervised domain adaptation often rely on minimizing some statistical distance between the source and target samples in the latent space. To avoid the sampl…
Contextual Dropout: An Efficient Sample-Dependent Dropout Module
Xinjie Fan, Shujian Zhang, Korawat Tanwisuth +2
Dropout has been demonstrated as a simple and effective module to not only regularize the training process of deep neural networks, but also provide the uncertainty estimation for…