119 citations · 125 across the 7 of their papers we have counts for
6 papers · 1 filter
A Preliminary Study of the Intrinsic Relationship between Complexity and Alignment
Yingxiu Zhao, Bowen Yu, Binyuan Hui +4
Training large language models (LLMs) with open-domain instruction data has yielded remarkable success in aligning to end tasks and human preferences. Extensive research has highli…
Causal Document-Grounded Dialogue Pre-training
Yingxiu Zhao, Bowen Yu, Haiyang Yu +6
The goal of document-grounded dialogue (DocGD) is to generate a response by grounding the evidence in a supporting document in accordance with the dialogue context. This process in…
Prompt Conditioned VAE: Enhancing Generative Replay for Lifelong Learning in Task-Oriented Dialogue
Yingxiu Zhao, Yinhe Zheng, Zhiliang Tian +6
Lifelong learning (LL) is vital for advanced task-oriented dialogue (ToD) systems. To address the catastrophic forgetting issue of LL, generative replay methods are widely employed…
Semi-Supervised Lifelong Language Learning
Yingxiu Zhao, Yinhe Zheng, Bowen Yu +6
Lifelong learning aims to accumulate knowledge and alleviate catastrophic forgetting when learning tasks sequentially. However, existing lifelong language learning methods only foc…
Hard Gate Knowledge Distillation -- Leverage Calibration for Robust and Reliable Language Model
Dongkyu Lee, Zhiliang Tian, Yingxiu Zhao +2
In knowledge distillation, a student model is trained with supervisions from both knowledge from a teacher and observations drawn from a training data distribution. Knowledge of a…
Improving Meta-learning for Low-resource Text Classification and Generation via Memory Imitation
Yingxiu Zhao, Zhiliang Tian, Huaxiu Yao +5
Building models of natural language processing (NLP) is challenging in low-resource scenarios where only limited data are available. Optimization-based meta-learning algorithms ach…