3 papers
cs.SE2026
How Far Are We from Detecting Flaky Tests? On the Limits of Code-Based Detection
Ömer Oktay Gültekin, Alexander Berndt, Jonathan Bell +2
Flaky tests pass and fail on the same code version, weakening the signal of test results and disrupting continuous integration (CI) pipelines. Code-based flakiness detectors report…
cs.SE2024
230,439 Test Failures Later: An Empirical Evaluation of Flaky Failure Classifiers
Abdulrahman Alshammari, Paul Ammann, Michael Hilton +1
Flaky tests are tests that can non-deterministically pass or fail, even in the absence of code changes.Despite being a source of false alarms, flaky tests often remain in test suit…
cs.SE2023
The Effects of Computational Resources on Flaky Tests
Denini Silva, Martin Gruber, Satyajit Gokhale +6
Flaky tests are tests that nondeterministically pass and fail in unchanged code. These tests can be detrimental to developers' productivity. Particularly when tests run in continuo…