output
20032025
most citedNatural Language Processing (almost) from Scratch

5.2k citations

Showing 2021 · cs.CLShow all

13 papers · 2 filters

cs.CL2021

MEDCOD: A Medically-Accurate, Emotive, Diverse, and Controllable Dialog System

Rhys Compton, Ilya Valmianski, Li Deng +4

We present MEDCOD, a Medically-Accurate, Emotive, Diverse, and Controllable Dialog system with a unique approach to the natural language generator module. MEDCOD has been developed…

cs.CL2021★ 1 cited

A Word on Machine Ethics: A Response to Jiang et al. (2021)

Zeerak Talat, Hagen Blix, Josef Valvoda +3

Ethics is one of the longest standing intellectual endeavors of humanity. In recent years, the fields of AI and NLP have attempted to wrangle with how learning systems that interac…

cs.CL2021★ 2 cited

Types of Out-of-Distribution Texts and How to Detect Them

Udit Arora, William Huang, He He

Despite agreement on the importance of detecting out-of-distribution (OOD) examples, there is little consensus on the formal definition of OOD examples and how to best detect them.…

cs.CL2021

Ontology-Enhanced Slot Filling

Yuhao Ding, Yik-Cheung Tam

Slot filling is a fundamental task in dialog state tracking in task-oriented dialog systems. In multi-domain task-oriented dialog system, user utterances and system responses may m…

cs.CL2021★ 11 cited

A Unified Generative Framework for Aspect-Based Sentiment Analysis

Hang Yan, Junqi Dai, Tuo ji +2

Aspect-based Sentiment Analysis (ABSA) aims to identify the aspect terms, their corresponding sentiment polarities, and the opinion terms. There exist seven subtasks in ABSA. Most…

cs.CL2021★ 5 cited

A Unified Generative Framework for Various NER Subtasks

Hang Yan, Tao Gui, Junqi Dai +3

Named Entity Recognition (NER) is the task of identifying spans that represent entities in sentences. Whether the entity spans are nested or discontinuous, the NER task can be cate…

cs.CL2021★ 194 cited

True Few-Shot Learning with Language Models

Ethan Perez, Douwe Kiela, Kyunghyun Cho

Pretrained language models (LMs) perform well on many tasks even when learning from a few examples, but prior work uses many held-out examples to tune various aspects of learning,…

cs.CL2021

Retrieval Enhanced Model for Commonsense Generation

Han Wang, Yang Liu, Chenguang Zhu +4

Commonsense generation is a challenging task of generating a plausible sentence describing an everyday scenario using provided concepts. Its requirement of reasoning over commonsen…

cs.CL2021★ 77 cited

KLUE: Korean Language Understanding Evaluation

Sungjoon Park, Jihyung Moon, Sungdong Kim +28

We introduce Korean Language Understanding Evaluation (KLUE) benchmark. KLUE is a collection of 8 Korean natural language understanding (NLU) tasks, including Topic Classification,…

cs.CL2021

Doc2Dict: Information Extraction as Text Generation

Benjamin Townsend, Eamon Ito-Fisher, Lily Zhang +1

Typically, information extraction (IE) requires a pipeline approach: first, a sequence labeling model is trained on manually annotated documents to extract relevant spans; then, wh…

cs.CL2021★ 2 cited

Automatic Romanization of Arabic Bibliographic Records

Eryani Fadhl, Habash Nizar

International library standards require cataloguers to tediously input Romanization of their catalogue records for the benefit of library users without specific language expertise.…

cs.CL2021★ 141 cited

The Interplay of Variant, Size, and Task Type in Arabic Pre-trained Language Models

Go Inoue, Bashar Alhafni, Nurpeiis Baimukan +2

In this paper, we explore the effects of language variants, data sizes, and fine-tuning task types in Arabic pre-trained language models. To do so, we build three pre-trained langu…

cs.CL2021★ 7 cited

MixUp Training Leads to Reduced Overfitting and Improved Calibration for the Transformer Architecture

Wancong Zhang, Ieshan Vaidya

MixUp is a computer vision data augmentation technique that uses convex interpolations of input data and their labels to enhance model generalization during training. However, the…