Empirica: a virtual lab for high-throughput macro-level experiments
arXiv:2006.11398 · doi:10.3758/s13428-020-01535-9
Abstract
Virtual labs allow researchers to design high-throughput and macro-level experiments that are not feasible in traditional in-person physical lab settings. Despite the increasing popularity of online research, researchers still face many technical and logistical barriers when designing and deploying virtual lab experiments. While several platforms exist to facilitate the development of virtual lab experiments, they typically present researchers with a stark trade-off between usability and functionality. We introduce Empirica: a modular virtual lab that offers a solution to the usability-functionality trade-off by employing a "flexible defaults" design strategy. This strategy enables us to maintain complete "build anything" flexibility while offering a development platform that is accessible to novice programmers. Empirica's architecture is designed to allow for parameterizable experimental designs, reusable protocols, and rapid development. These features will increase the accessibility of virtual lab experiments, remove barriers to innovation in experiment design, and enable rapid progress in the understanding of distributed human computation.
arXiv comment36 pages, 6 figures. Accepted to Behavioral Research Methods. Behav Res (2021)
References in corpus (5)
- BoTorch: A Framework for Efficient Monte-Carlo Bayesian Optimization
- Cognitive Model Priors for Predicting Human Decisions
- Optimal design of experiments to identify latent behavioral types
- Probabilistic Social Learning Improves the Public's Detection of Misinformation
- Interdependent Diffusion: The social contagion of interacting beliefs
Cited by in corpus (4)
- On the Conversational Persuasiveness of Large Language Models: A Randomized Controlled Trial
- Experiments as Code: A Concept for Reproducible, Auditable, Debuggable, Reusable, & Scalable Experiments
- Gender Bias in Perception of Human Managers Extends to AI Managers
- StudyAlign: A Software System for Conducting Web-Based User Studies with Functional Interactive Prototypes