On Wasted Contributions: Understanding the Dynamics of Contributor-Abandoned Pull Requests
arXiv:2110.15447 · doi:10.1145/3530785
Abstract
Pull-based development has enabled numerous volunteers to contribute to open-source projects with fewer barriers. Nevertheless, a considerable amount of pull requests (PRs) with valid contributions are abandoned by their contributors, wasting the effort and time put in by both the contributors and maintainers. To better understand the underlying dynamics of contributor-abandoned PRs, we conduct a mixed-methods study using both quantitative and qualitative methods. We curate a dataset consisting of 265,325 PRs including 4,450 abandoned ones from ten popular and mature GitHub projects and measure 16 features characterizing PRs, contributors, review processes, and projects. Using statistical and machine learning techniques, we find that complex PRs, novice contributors, and lengthy reviews have a higher probability of abandonment and the rate of PR abandonment fluctuates alongside the projects' maturity or workload. To identify why contributors abandon their PRs, we also manually examine a random sample of 354 abandoned PRs. We observe that the most frequent abandonment reasons are related to the obstacles faced by contributors, followed by the hurdles imposed by maintainers during the review process. Finally, we survey the top core maintainers of the studied projects to understand their perspectives on dealing with PR abandonment and on our findings.
arXiv commentManuscript accepted for publication in ACM Transactions on Software Engineering and Methodology (TOSEM)
References in corpus (8)
- Scikit-learn: Machine Learning in Python
- ranger: A Fast Implementation of Random Forests for High Dimensional Data in C++ and R
- Hyperparameters and Tuning Strategies for Random Forest
- All Models are Wrong, but Many are Useful: Learning a Variable's Importance by Studying an Entire Class of Prediction Models Simultaneously
- Understanding the Factors that Impact the Popularity of GitHub Repositories
- What's in a GitHub Star? Understanding Repository Starring Practices in a Social Coding Platform
- Pull Request Decision Explained: An Empirical Overview
- GAP2WSS: A Genetic Algorithm based on the Pareto Principle for Web Service Selection