345 citations · 840 across the 61 of their papers we have counts for
8 papers · 1 filter
Prompt Conditioned VAE: Enhancing Generative Replay for Lifelong Learning in Task-Oriented Dialogue
Yingxiu Zhao, Yinhe Zheng, Zhiliang Tian +6
Lifelong learning (LL) is vital for advanced task-oriented dialogue (ToD) systems. To address the catastrophic forgetting issue of LL, generative replay methods are widely employed…
Semi-Supervised Lifelong Language Learning
Yingxiu Zhao, Yinhe Zheng, Bowen Yu +6
Lifelong learning aims to accumulate knowledge and alleviate catastrophic forgetting when learning tasks sequentially. However, existing lifelong language learning methods only foc…
ViT-CX: Causal Explanation of Vision Transformers
Weiyan Xie, Xiao-Hui Li, Caleb Chen Cao +1
Despite the popularity of Vision Transformers (ViTs) and eXplainable AI (XAI), only a few explanation methods have been designed specially for ViTs thus far. They mostly use attent…
Adaptive Label Smoothing with Self-Knowledge in Natural Language Generation
Dongkyu Lee, Ka Chun Cheung, Nevin L. Zhang
Overconfidence has been shown to impair generalization and calibration of a neural network. Previous studies remedy this issue by adding a regularization term to a loss function, p…
Hard Gate Knowledge Distillation -- Leverage Calibration for Robust and Reliable Language Model
Dongkyu Lee, Zhiliang Tian, Yingxiu Zhao +2
In knowledge distillation, a student model is trained with supervisions from both knowledge from a teacher and observations drawn from a training data distribution. Knowledge of a…
Deep Clustering with Features from Self-Supervised Pretraining
Xingzhi Zhou, Nevin L. Zhang
A deep clustering model conceptually consists of a feature extractor that maps data points to a latent space, and a clustering head that groups data points into clusters in the lat…