activity
20212025
most citedAn Empirical Study of Flaky Tests in Python

72 citations · 77 across the 9 of their papers we have counts for

collaborators
Showing cs.SEShow all

9 papers · 1 filter

cs.SE2025

Improving Merge Pipeline Throughput in Continuous Integration via Pull Request Prioritization

Maximilian Jungwirth, Martin Gruber, Gordon Fraser

Integrating changes into large monolithic software repositories is a critical step in modern software development that substantially impacts the speed of feature delivery, the stab…

cs.SE2025

Practical Pipeline-Aware Regression Test Optimization for Continuous Integration

Daniel Schwendner, Maximilian Jungwirth, Martin Gruber +3

Massive, multi-language, monolithic repositories form the backbone of many modern, complex software systems. To ensure consistent code quality while still allowing fast development…

cs.SE2023

The Effects of Computational Resources on Flaky Tests

Denini Silva, Martin Gruber, Satyajit Gokhale +6

Flaky tests are tests that nondeterministically pass and fail in unchanged code. These tests can be detrimental to developers' productivity. Particularly when tests run in continuo…

cs.SE2023

Do Automatic Test Generation Tools Generate Flaky Tests?

Martin Gruber, Muhammad Firhard Roslan, Owain Parry +3

Non-deterministic test behavior, or flakiness, is common and dreaded among developers. Researchers have studied the issue and proposed approaches to mitigate it. However, the vast…

cs.SE2023

FlaPy: Mining Flaky Python Tests at Scale

Martin Gruber, Gordon Fraser

Flaky tests obstruct software development, and studying and proposing mitigations against them has therefore become an important focus of software engineering research. To conduct…

cs.SE2023

Debugging Flaky Tests using Spectrum-based Fault Localization

Martin Gruber, Gordon Fraser

Non-deterministically behaving (i.e., flaky) tests hamper regression testing as they destroy trust and waste computational and human resources. Eradicating flakiness in test suites…

cs.SE2023★ 2 cited

Practical Flaky Test Prediction using Common Code Evolution and Test History Data

Martin Gruber, Michael Heine, Norbert Oster +2

Non-deterministically behaving test cases cause developers to lose trust in their regression test suites and to eventually ignore failures. Detecting flaky tests is therefore a cru…

cs.SE2022★ 3 cited

A Survey on How Test Flakiness Affects Developers and What Support They Need To Address It

Martin Gruber, Gordon Fraser

Non-deterministically passing and failing test cases, so-called flaky tests, have recently become a focus area of software engineering research. While this research focus has been…

cs.SE2021★ 72 cited

An Empirical Study of Flaky Tests in Python

Martin Gruber, Stephan Lukasczyk, Florian Kroiß +1

Tests that cause spurious failures without any code changes, i.e., flaky tests, hamper regression testing, increase maintenance costs, may shadow real bugs, and decrease trust in t…