36 citations · 128 across the 24 of their papers we have counts for
8 papers · 1 filter
POUF: Prompt-oriented unsupervised fine-tuning for large pre-trained models
Korawat Tanwisuth, Shujian Zhang, Huangjie Zheng +2
Through prompting, large-scale pre-trained models have become more expressive and powerful, gaining significant attention in recent years. Though these big models have zero-shot ca…
A Prototype-Oriented Clustering for Domain Shift with Source Privacy
Korawat Tanwisuth, Shujian Zhang, Pengcheng He +1
Unsupervised clustering under domain shift (UCDS) studies how to transfer the knowledge from abundant unlabeled data from multiple source domains to learn the representation of the…
A Unified Framework for Alternating Offline Model Training and Policy Learning
Shentao Yang, Shujian Zhang, Yihao Feng +1
In offline model-based reinforcement learning (offline MBRL), we learn a dynamic model from historically collected data, and subsequently utilize the learned model and fixed datase…
Regularizing a Model-based Policy Stationary Distribution to Stabilize Offline Reinforcement Learning
Shentao Yang, Yihao Feng, Shujian Zhang +1
Offline reinforcement learning (RL) extends the paradigm of classical RL algorithms to purely learning from static datasets, without interacting with the underlying environment dur…
Alignment Attention by Matching Key and Query Distributions
Shujian Zhang, Xinjie Fan, Huangjie Zheng +2
The neural attention mechanism has been incorporated into deep neural networks to achieve state-of-the-art performance in various domains. Most such models use multi-head self-atte…
A Prototype-Oriented Framework for Unsupervised Domain Adaptation
Korawat Tanwisuth, Xinjie Fan, Huangjie Zheng +4
Existing methods for unsupervised domain adaptation often rely on minimizing some statistical distance between the source and target samples in the latent space. To avoid the sampl…
Bayesian Attention Belief Networks
Shujian Zhang, Xinjie Fan, Bo Chen +1
Attention-based neural networks have achieved state-of-the-art results on a wide range of tasks. Most such models use deterministic attention while stochastic attention is less exp…
Contextual Dropout: An Efficient Sample-Dependent Dropout Module
Xinjie Fan, Shujian Zhang, Korawat Tanwisuth +2
Dropout has been demonstrated as a simple and effective module to not only regularize the training process of deep neural networks, but also provide the uncertainty estimation for…