ContrastNER: Contrastive-based Prompt Tuning for Few-shot NER

Abstract

Prompt-based language models have produced encouraging results in numerous applications, including Named Entity Recognition (NER) tasks. NER aims to identify entities in a sentence and provide their types. However, the strong performance of most available NER approaches is heavily dependent on the design of discrete prompts and a verbalizer to map the model-predicted outputs to entity categories, which are complicated undertakings. To address these challenges, we present ContrastNER, a prompt-based NER framework that employs both discrete and continuous tokens in prompts and uses a contrastive learning approach to learn the continuous prompts and forecast entity types. The experimental results demonstrate that ContrastNER obtains competitive performance to the state-of-the-art NER methods in high-resource settings and outperforms the state-of-the-art models in low-resource circumstances without requiring extensive manual prompt engineering and verbalizer design.

9 pages, 5 figures, COMPSAC2023

References in corpus (8)

• A Simple Framework for Contrastive Learning of Visual Representations
• Introduction to the CoNLL-2002 Shared Task: Language-Independent Named Entity Recognition
• Contrastive Representation Learning: A Framework and Review
• P-Tuning v2: Prompt Tuning Can Be Comparable to Fine-tuning Universally Across Scales and Tasks
• Few-shot classification in Named Entity Recognition Task
• Prototypical Representation Learning for Relation Extraction
• Example-Based Named Entity Recognition
• QaNER: Prompting Question Answering Models for Few-shot Named Entity Recognition