Exploring Data Pipelines through the Process Lens: a Reference Model forComputer Vision
arXiv:2107.01824
Abstract
Researchers have identified datasets used for training computer vision (CV) models as an important source of hazardous outcomes, and continue to examine popular CV datasets to expose their harms. These works tend to treat datasets as objects, or focus on particular steps in data production pipelines. We argue here that we could further systematize our analysis of harms by examining CV data pipelines through a process-oriented lens that captures the creation, the evolution and use of these datasets. As a step towards cultivating a process-oriented lens, we embarked on an empirical study of CV data pipelines informed by the field of method engineering. We present here a preliminary result: a reference model of CV data pipelines. Besides exploring the questions that this endeavor raises, we discuss how the process lens could support researchers in discovering understudied issues, and could help practitioners in making their processes more transparent.
arXiv commentPresented at the CVPR workshop 2021 Beyond Fair Computer Vision
References in corpus (5)
- Exploring the Landscape of Spatial Robustness
- No Classification without Representation: Assessing Geodiversity Issues in Open Data Sets for the Developing World
- Improving the Robustness of Deep Neural Networks via Stability Training
- Data and its (dis)contents: A survey of dataset development and use in machine learning research
- Bringing the People Back In: Contesting Benchmark Machine Learning Datasets