Bayesian Hierarchical Modelling for Tailoring Metric Thresholds
arXiv:1804.02443 · doi:10.1145/3196398.3196443
Abstract
Software is highly contextual. While there are cross-cutting `global' lessons, individual software projects exhibit many `local' properties. This data heterogeneity makes drawing local conclusions from global data dangerous. A key research challenge is to construct locally accurate prediction models that are informed by global characteristics and data volumes. Previous work has tackled this problem using clustering and transfer learning approaches, which identify locally similar characteristics. This paper applies a simpler approach known as Bayesian hierarchical modeling. We show that hierarchical modeling supports cross-project comparisons, while preserving local context. To demonstrate the approach, we conduct a conceptual replication of an existing study on setting software metrics thresholds. Our emerging results show our hierarchical model reduces model prediction error compared to a global approach by up to 50%.
arXiv commentShort paper, published at MSR '18: 15th International Conference on Mining Software Repositories May 28--29, 2018, Gothenburg, Sweden
References in corpus (2)
Cited by in corpus (4)
- Evolution of statistical analysis in empirical software engineering research: Current state and steps forward
- Bayesian Data Analysis in Empirical Software Engineering Research
- Underproduction: An Approach for Measuring Risk in Open Source Software
- Applying Bayesian Data Analysis for Causal Inference about Requirements Quality: A Controlled Experiment