activity
20212026
most citedWhat Makes Good Data for Alignment? A Comprehensive Study of Automatic Data Selection in Instruction Tuning

15 citations · 64 across the 39 of their papers we have counts for

collaborators
Showing 2023Show all

14 papers · 1 filter

cs.CL2023★ 15 cited

What Makes Good Data for Alignment? A Comprehensive Study of Automatic Data Selection in Instruction Tuning

Wei Liu, Weihao Zeng, Keqing He +2

Instruction tuning is a standard technique employed to align large language models to end tasks and user preferences after the initial pretraining phase. Recent research indicates…

cs.CL2023★ 4 cited

APP: Adaptive Prototypical Pseudo-Labeling for Few-shot OOD Detection

Pei Wang, Keqing He, Yutao Mou +6

Detecting out-of-domain (OOD) intents from user queries is essential for a task-oriented dialogue system. Previous OOD detection studies generally work on the assumption that plent…

cs.CL2023

Continual Generalized Intent Discovery: Marching Towards Dynamic and Open-world Intent Recognition

Xiaoshuai Song, Yutao Mou, Keqing He +3

In a practical dialogue system, users may input out-of-domain (OOD) queries. The Generalized Intent Discovery (GID) task aims to discover OOD intents from OOD queries and extend th…

cs.CL2023

Large Language Models Meet Open-World Intent Discovery and Recognition: An Evaluation of ChatGPT

Xiaoshuai Song, Keqing He, Pei Wang +6

The tasks of out-of-domain (OOD) intent discovery and generalized intent discovery (GID) aim to extend a closed intent classifier to open-world intent sets, which is crucial to tas…

cs.CL2023

Revisit Input Perturbation Problems for LLMs: A Unified Robustness Evaluation Framework for Noisy Slot Filling Task

Guanting Dong, Jinxu Zhao, Tingfeng Hui +8

With the increasing capabilities of large language models (LLMs), these high-performance models have achieved state-of-the-art results on a wide range of natural language processin…

cs.CL2023★ 3 cited

Towards Robust and Generalizable Training: An Empirical Study of Noisy Slot Filling for Input Perturbations

Jiachi Liu, Liwen Wang, Guanting Dong +8

In real dialogue scenarios, as there are unknown input noises in the utterances, existing supervised slot filling models often perform poorly in practical applications. Even though…

cs.CL2023★ 1 cited

A Multi-Task Semantic Decomposition Framework with Task-specific Pre-training for Few-Shot NER

Guanting Dong, Zechen Wang, Jinxu Zhao +10

The objective of few-shot named entity recognition is to identify named entities with limited labeled instances. Previous works have primarily focused on optimizing the traditional…

cs.CL2023

Generative Zero-Shot Prompt Learning for Cross-Domain Slot Filling with Inverse Prompting

Xuefeng Li, Liwen Wang, Guanting Dong +5

Zero-shot cross-domain slot filling aims to transfer knowledge from the labeled source domain to the unlabeled target domain. Existing models either encode slot descriptions and ex…

cs.CL2023

Seen to Unseen: Exploring Compositional Generalization of Multi-Attribute Controllable Dialogue Generation

Weihao Zeng, Lulu Zhao, Keqing He +4

Existing controllable dialogue generation work focuses on the single-attribute control and lacks generalization capability to out-of-distribution multiple attribute combinations. I…

cs.CL2023

FutureTOD: Teaching Future Knowledge to Pre-trained Language Model for Task-Oriented Dialogue

Weihao Zeng, Keqing He, Yejie Wang +4

Pre-trained language models based on general text enable huge success in the NLP scenario. But the intrinsical difference of linguistic patterns between general text and task-orien…

cs.CL2023★ 1 cited

GKD: A General Knowledge Distillation Framework for Large-scale Pre-trained Language Model

Shicheng Tan, Weng Lam Tam, Yuanchun Wang +9

Currently, the reduction in the parameter scale of large-scale pre-trained language models (PLMs) through knowledge distillation has greatly facilitated their widespread deployment…

cs.CL2023

Decoupling Pseudo Label Disambiguation and Representation Learning for Generalized Intent Discovery

Yutao Mou, Xiaoshuai Song, Keqing He +5

Generalized intent discovery aims to extend a closed-set in-domain intent classifier to an open-world intent set including in-domain and out-of-domain intents. The key challenges l…

cs.CL2023★ 1 cited

Revisit Out-Of-Vocabulary Problem for Slot Filling: A Unified Contrastive Frameword with Multi-level Data Augmentations

Daichi Guo, Guanting Dong, Dayuan Fu +9

In real dialogue scenarios, the existing slot filling model, which tends to memorize entity patterns, has a significantly reduced generalization facing Out-of-Vocabulary (OOV) prob…

cs.CL2023

A Prototypical Semantic Decoupling Method via Joint Contrastive Learning for Few-Shot Name Entity Recognition

Guanting Dong, Zechen Wang, Liwen Wang +10

Few-shot named entity recognition (NER) aims at identifying named entities based on only few labeled instances. Most existing prototype-based sequence labeling models tend to memor…