4 papers
Crowdsourcing Diverse Paraphrases for Training Task-oriented Bots
Jorge Ramírez, Auday Berro, Marcos Baez +2
A prominent approach to build datasets for training task-oriented bots is crowd-based paraphrasing. Current approaches, however, assume the crowd would naturally provide diverse pa…
On the state of reporting in crowdsourcing experiments and a checklist to aid current practices
Jorge Ramírez, Burcu Sayin, Marcos Baez +4
Crowdsourcing is being increasingly adopted as a platform to run studies with human subjects. Running a crowdsourcing experiment involves several choices and strategies to successf…
On the impact of predicate complexity in crowdsourced classification tasks
Jorge Ramírez, Marcos Baez, Fabio Casati +4
This paper explores and offers guidance on a specific and relevant problem in task design for crowdsourcing: how to formulate a complex question used to classify a set of items. In…
Challenges and strategies for running controlled crowdsourcing experiments
Jorge Ramírez, Marcos Baez, Fabio Casati +2
This paper reports on the challenges and lessons we learned while running controlled experiments in crowdsourcing platforms. Crowdsourcing is becoming an attractive technique to en…