APP: Adaptive Prototypical Pseudo-Labeling for Few-shot OOD Detection

Abstract

Detecting out-of-domain (OOD) intents from user queries is essential for a task-oriented dialogue system. Previous OOD detection studies generally work on the assumption that plenty of labeled IND intents exist. In this paper, we focus on a more practical few-shot OOD setting where there are only a few labeled IND data and massive unlabeled mixed data that may belong to IND or OOD. The new scenario carries two key challenges: learning discriminative representations using limited IND data and leveraging unlabeled mixed data. Therefore, we propose an adaptive prototypical pseudo-labeling (APP) method for few-shot OOD detection, including a prototypical OOD detection framework (ProtoOOD) to facilitate low-resource OOD detection using limited IND data, and an adaptive pseudo-labeling method to produce high-quality pseudo OOD\&IND labels. Extensive experiments and analysis demonstrate the effectiveness of our method for few-shot OOD detection.

References in corpus (7)

• Adam: A Method for Stochastic Optimization
• FixMatch: Simplifying Semi-Supervised Learning with Consistency and Confidence
• A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networks
• A Simple Unified Framework for Detecting Out-of-Distribution Samples and Adversarial Attacks
• Prototypical Contrastive Learning of Unsupervised Representations
• Distribution Calibration for Out-of-Domain Detection with Bayesian Approximation
• Disentangling Confidence Score Distribution for Out-of-Domain Intent Detection with Energy-Based Learning