A Step Toward More Inclusive People Annotations for Fairness

Abstract

The Open Images Dataset contains approximately 9 million images and is a widely accepted dataset for computer vision research. As is common practice for large datasets, the annotations are not exhaustive, with bounding boxes and attribute labels for only a subset of the classes in each image. In this paper, we present a new set of annotations on a subset of the Open Images dataset called the MIAP (More Inclusive Annotations for People) subset, containing bounding boxes and attributes for all of the people visible in those images. The attributes and labeling methodology for the MIAP subset were designed to enable research into model fairness. In addition, we analyze the original annotation methodology for the person class and its subclasses, discussing the resulting patterns in order to inform future annotation efforts. By considering both the original and exhaustive annotation sets, researchers can also now study how systematic patterns in training annotations affect modeling.

References in corpus (1)

• Towards Fairer Datasets: Filtering and Balancing the Distribution of the People Subtree in the ImageNet Hierarchy

Cited by in corpus (6)

• Adversarial attacks and defenses in explainable artificial intelligence: A survey
• Ground Truth Or Dare: Factors Affecting The Creation Of Medical Datasets For Training AI
• Auditing Gender Presentation Differences in Text-to-Image Models
• Evaluating the Fairness of Discriminative Foundation Models in Computer Vision
• For a semiotic AI: Bridging computer vision and visual semiotics for computational observation of large scale facial image archives
• Algorithmic Fairness Datasets: the Story so Far