4 papers
Call-Chain-Aware LLM-Based Test Generation for Java Projects
Guancheng Wang, Qinghua Xu, Lionel C. Briand +2
Large language models (LLMs) have recently shown strong potential for generating project-level unit tests. However, existing state-of-the-art approaches primarily rely on execution…
SWE-ABS: Adversarial Benchmark Strengthening Exposes Inflated Success Rates on Test-based Benchmark
Boxi Yu, Yang Cao, Yuzhong Zhang +9
The SWE-Bench Verified leaderboard is approaching saturation, with the top system achieving 78.80%. However, we show that this performance is inflated. Our re-evaluation reveals th…
Mutation-Guided Unit Test Generation with a Large Language Model
Guancheng Wang, Qinghua Xu, Lionel Briand +1
Unit tests play a vital role in uncovering potential faults in software. While tools like EvoSuite focus on maximizing code coverage, recent advances in large language models (LLMs…
Hallucination to Consensus: Multi-Agent LLMs for End-to-End JUnit Test Generation
Qinghua Xu, Guancheng Wang, Lionel Briand +1
Unit testing plays a critical role in ensuring software correctness. However, writing unit tests manually is labor-intensive, especially for strongly typed languages like Java, mot…