CORRECT: Code Reviewer Recommendation in GitHub Based on Cross-Project and Technology Experience
arXiv:1807.02965 · doi:10.1145/2889160.2889244
Abstract
Peer code review locates common coding rule violations and simple logical errors in the early phases of software development, and thus reduces overall cost. However, in GitHub, identifying an appropriate code reviewer for a pull request is a non-trivial task given that reliable information for reviewer identification is often not readily available. In this paper, we propose a code reviewer recommendation technique that considers not only the relevant cross-project work history (e.g., external library experience) but also the experience of a developer in certain specialized technologies associated with a pull request for determining her expertise as a potential code reviewer. We first motivate our technique using an exploratory study with 10 commercial projects and 10 associated libraries external to those projects. Experiments using 17,115 pull requests from 10 commercial projects and six open source projects show that our technique provides 85%--92% recommendation accuracy, about 86% precision and 79%--81% recall in code reviewer recommendation, which are highly promising. Comparison with the state-of-the-art technique also validates the empirical findings and the superiority of our recommendation technique.
The 38th International Conference on Software Engineering (Companion volume) (ICSE 2016), pp. 222--231, Austin Texas, USA, May 2016
Cited by in corpus (14)
- CC2Vec: Distributed Representations of Code Changes
- A Systematic Literature Review and Taxonomy of Modern Code Review
- A Large-Scale Study on Source Code Reviewer Recommendation
- Modern Code Reviews -- Survey of Literature and Practice
- Modern code reviews -- Preliminary results of a systematic mapping study
- Code Reviews with Divergent Review Scores: An Empirical Study of the OpenStack and Qt Communities
- CORRECT: Code Reviewer Recommendation at GitHub for Vendasta Technologies
- Why are Some Bugs Non-Reproducible? An Empirical Investigation using Data Fusion
- Wisdom in Sum of Parts: Multi-Platform Activity Prediction in Social Collaborative Sites
- An Empirical Study on Code Review Activity Prediction and Its Impact in Practice
- Can We Benchmark Code Review Studies? A Systematic Mapping Study of Methodology, Dataset, and Metric
- Keen2Act: Activity Recommendation in Online Social Collaborative Platforms
- Ownership at Large -- Open Problems and Challenges in Ownership Management
- Predicting Usefulness of Code Review Comments using Textual Features and Developer Experience