3 papers
cs.SE2024
Do Test and Environmental Complexity Increase Flakiness? An Empirical Study of SAP HANA
Alexander Berndt, Thomas Bach, Sebastian Baltes
Background: Test flakiness is a major problem in the software industry. Flaky tests fail seemingly at random without changes to the code and thus impede continuous integration (CI)…
cs.DB2024
BIPeC: A Combined Change-Point Analyzer to Identify Performance Regressions in Large-scale Database Systems
Zhan Lyu, Thomas Bach, Yong Li +2
Performance testing in large-scale database systems like SAP HANA is a crucial yet labor-intensive task, involving extensive manual analysis of thousands of measurements, such as C…
cs.SE2023
Just-in-Time Flaky Test Detection via Abstracted Failure Symptom Matching
Gabin An, Juyeon Yoon, Thomas Bach +2
We report our experience of using failure symptoms, such as error messages or stack traces, to identify flaky test failures in a Continuous Integration (CI) pipeline for a large in…