Eliciting Best Practices for Collaboration with Computational Notebooks
arXiv:2202.07233 · doi:10.1145/3512934
Abstract
Despite the widespread adoption of computational notebooks, little is known about best practices for their usage in collaborative contexts. In this paper, we fill this gap by eliciting a catalog of best practices for collaborative data science with computational notebooks. With this aim, we first look for best practices through a multivocal literature review. Then, we conduct interviews with professional data scientists to assess their awareness of these best practices. Finally, we assess the adoption of best practices through the analysis of 1,380 Jupyter notebooks retrieved from the Kaggle platform. Findings reveal that experts are mostly aware of the best practices and tend to adopt them in their daily work. Nonetheless, they do not consistently follow all the recommendations as, depending on specific contexts, some are deemed unfeasible or counterproductive due to the lack of proper tool support. As such, we envision the design of notebook solutions that allow data scientists not to have to prioritize exploration and rapid prototyping over writing code of quality.
References in corpus (6)
- Do Code Clones Matter?
- Human-AI Collaboration in Data Science: Exploring Data Scientists' Perceptions of Automated AI
- Trust in Data Science: Collaboration, Translation, and Accountability in Corporate Data Science Projects
- Using Jupyter for reproducible scientific workflows
- Agile Collaboration for Distributed Teams
- Ten Simple Rules for Reproducible Research in Jupyter Notebooks
Cited by in corpus (7)
- CoPrompt: Supporting Prompt Sharing and Referring in Collaborative Natural Language Programming
- Teaching MLOps in Higher Education through Project-Based Learning
- Pynblint: a Static Analyzer for Python Jupyter Notebooks
- Enhancing Computational Notebooks with Code+Data Space Versioning
- A Systematic Literature Review of Software Engineering Research on Jupyter Notebook
- Exploratory Data Science on Supercomputers for Quantum Mechanical Calculations
- Are the Majority of Public Computational Notebooks Pathologically Non-Executable?