Naming the Pain in Requirements Engineering: A Design for a Global Family of Surveys and First Results from Germany
arXiv:1611.09511 · doi:10.1016/j.infsof.2014.05.008
Abstract
For many years, we have observed industry struggling in defining a high quality requirements engineering (RE) and researchers trying to understand industrial expectations and problems. Although we are investigating the discipline with a plethora of empirical studies, they still do not allow for empirical generalisations. To lay an empirical and externally valid foundation about the state of the practice in RE, we aim at a series of open and reproducible surveys that allow us to steer future research in a problem-driven manner. We designed a globally distributed family of surveys in joint collaborations with different researchers and completed the first run in Germany. The instrument is based on a theory in the form of a set of hypotheses inferred from our experiences and available studies. We test each hypothesis in our theory and identify further candidates to extend the theory by correlation and Grounded Theory analysis. In this article, we report on the design of the family of surveys, its underlying theory, and the full results obtained from Germany with participants from 58 companies. The results reveal, for example, a tendency to improve RE via internally defined qualitative methods rather than relying on normative approaches like CMMI. We also discovered various RE problems that are statistically significant in practice. For instance, we could corroborate communication flaws or moving targets as problems in practice. Our results are not yet fully representative but already give first insights into current practices and problems in RE, and they allow us to draw lessons learnt for future replications. Our results obtained from this first run in Germany make us confident that the survey design and instrument are well-suited to be replicated and, thereby, to create a generalisable empirical basis of RE in practice.
References in corpus (2)
Cited by in corpus (15)
- Naming the Pain in Requirements Engineering: Contemporary Problems, Causes, and Effects in Practice
- Rapid quality assurance with Requirements Smells
- Naming the Pain in Requirements Engineering: A Design for a Global Family of Surveys and First Results from Germany
- Artefact-based Requirements Engineering: The AMDiRE Approach
- The State-of-Practice in Requirements Elicitation: An Extended Interview Study at 12 Companies
- Naming the Pain in Requirements Engineering: Comparing Practices in Brazil and Germany
- Why and How to Balance Alignment and Diversity of Requirements Engineering Practices in Automotive
- How to Integrate Security Compliance Requirements with Agile Software Engineering at Scale?
- Analysing Text in Software Projects
- Preventing Incomplete/Hidden Requirements: Reflections on Survey Data from Austria and Brazil
- Which Requirements Artifact Quality Defects are Automatically Detectable? A Case Study
- Useful Statistical Methods for Human Factors Research in Software Engineering: A Discussion on Validation with Quantitative Data
- Towards Guidelines for Preventing Critical Requirements Engineering Problems
- A Field Study on the Elicitation and Classification of Defects for Defect Models
- A Case Study on Artefact-based RE Improvement in Practice