A Baseline Model for Software Effort Estimation
arXiv:2102.02933 · doi:10.1145/2738037
Abstract
Software effort estimation (SEE) is a core activity in all software processes and development lifecycles. A range of increasingly complex methods has been considered in the past 30 years for the prediction of effort, often with mixed and contradictory results. The comparative assessment of effort prediction methods has therefore become a common approach when considering how best to predict effort over a range of project types. Unfortunately, these assessments use a variety of sampling methods and error measurements, making comparison with other work difficult. This article proposes an automatically transformed linear model (ATLM) as a suitable baseline model for comparison against SEE methods. ATLM is simple yet performs well over a range of different project types. In addition, ATLM may be used with mixed numeric and categorical data and requires no parameter tuning. It is also deterministic, meaning that results obtained are amenable to replication. These and other arguments for using ATLM as a baseline model are presented, and a reference implementation described and made available. We suggest that ATLM should be used as a baseline of effort prediction quality for all future model comparisons in SEE.
Journal Paper, 8 pages, 2 tables, 1 figure, 2 algorithms
References in corpus (2)
Cited by in corpus (13)
- Finite volume method network for acceleration of unsteady computational fluid dynamics: non-reacting and reacting flows
- Agile Effort Estimation: Have We Solved the Problem Yet? Insights From A Replication Study
- Hyperparameter Optimization for Effort Estimation
- Investigating the Significance of the Bellwether Effect to Improve Software Effort Prediction: Further Empirical Study
- Investigating the Significance of Bellwether Effect to Improve Software Effort Estimation
- Negative Results for Software Effort Estimation
- OSS effort estimation using software features similarity and developer activity-based metrics
- MAT: A simple yet strong baseline for identifying self-admitted technical debt
- Bellwethers: A Baseline Method For Transfer Learning
- Sequential Model Optimization for Software Process Control
- Why Software Effort Estimation Needs SBSE
- "Sampling"' as a Baseline Optimizer for Search-based Software Engineering
- Analyzing the Stationarity Process in Software Effort Estimation Datasets