Crowd Coach: Peer Coaching for Crowd Workers' Skill Growth
arXiv:1811.05364 · doi:10.1145/3274306
Abstract
Traditional employment usually provides mechanisms for workers to improve their skills to access better opportunities. However, crowd work platforms like Amazon Mechanical Turk (AMT) generally do not support skill development (i.e., becoming faster and better at work). While researchers have started to tackle this problem, most solutions are dependent on experts or requesters willing to help. However, requesters generally lack the necessary knowledge, and experts are rare and expensive. To further facilitate crowd workers' skill growth, we present Crowd Coach, a system that enables workers to receive peer coaching while on the job. We conduct a field experiment and real world deployment to study Crowd Coach in the wild. Hundreds of workers used Crowd Coach in a variety of tasks, including writing, doing surveys, and labeling images. We find that Crowd Coach enhances workers' speed without sacrificing their work quality, especially in audio transcription tasks. We posit that peer coaching systems hold potential for better supporting crowd workers' skill development while on the job. We finish with design implications from our research.
arXiv comment17 pages, 4 figures
References in corpus (5)
- Botivist: Calling Volunteers to Action Using Online Bots
- Crowd Guilds: Worker-led Reputation and Feedback on Crowdsourcing Platforms
- Atelier: Repurposing Expert Crowdsourcing Tasks as Micro-internships
- "Is there anything else I can help you with?": Challenges in Deploying an On-Demand Crowd-Powered Conversational Agent
- Blockchain for Trustful Collaborations between Immigrants and Governments
Cited by in corpus (5)
- TurkScanner: Predicting the Hourly Wage of Microtasks
- Designing Sousveillance Tools for Gig Workers
- Inclusive Portraits: Race-Aware Human-in-the-Loop Technology
- How Formerly Incarcerated People Envision Technologies for Prison Parole
- A Labeling Task Design for Supporting Algorithmic Needs: Facilitating Worker Diversity and Reducing AI Bias