2 papers
cs.HC2023
EASE: An Easily-Customized Annotation System Powered by Efficiency Enhancement Mechanisms
Naihao Deng, Yikai Liu, Mingye Chen +5
The performance of current supervised AI systems is tightly connected to the availability of annotated datasets. Annotations are usually collected through annotation tools, which a…
cs.CL2023
You Are What You Annotate: Towards Better Models through Annotator Representations
Naihao Deng, Xinliang Frederick Zhang, Siyang Liu +3
Annotator disagreement is ubiquitous in natural language processing (NLP) tasks. There are multiple reasons for such disagreements, including the subjectivity of the task, difficul…