16 citations · 17 across the 8 of their papers we have counts for
8 papers
SWE-ABS: Adversarial Benchmark Strengthening Exposes Inflated Success Rates on Test-based Benchmark
Boxi Yu, Yang Cao, Yuzhong Zhang +9
The SWE-Bench Verified leaderboard is approaching saturation, with the top system achieving 78.80%. However, we show that this performance is inflated. Our re-evaluation reveals th…
A Structured Approach to Safety Case Construction for AI Systems
Sung Une Lee, Liming Zhu, Md Shamsujjoha +4
Safety cases, structured arguments that a system is acceptably safe, are becoming central to the governance of AI systems. Yet, traditional safety-case practices from aviation or n…
Fuzzing-based Mutation Testing of C/C++ Software in Cyber-Physical Systems
Jaekwon Lee, Fabrizio Pastore, Lionel Briand
Mutation testing can help minimize the delivery of faulty software. Therefore, it is a recommended practice for developing embedded software in safety-critical cyber-physical syste…
MOTIF: A tool for Mutation Testing with Fuzzing
Jaekwon Lee, Enrico Viganò, Fabrizio Pastore +1
Mutation testing consists of generating test cases that detect faults injected into software (generating mutants) which its original test suite could not. By running such an augmen…
Search-based DNN Testing and Retraining with GAN-enhanced Simulations
Mohammed Oualid Attaoui, Fabrizio Pastore, Lionel Briand
In safety-critical systems (e.g., autonomous vehicles and robots), Deep Neural Networks (DNNs) are becoming a key component for computer vision tasks, particularly semantic segment…
System Safety Monitoring of Learned Components Using Temporal Metric Forecasting
Sepehr Sharifi, Andrea Stocco, Lionel C. Briand
In learning-enabled autonomous systems, safety monitoring of learned components is crucial to ensure their outputs do not lead to system safety violations, given the operational co…
AIM: Automated Input Set Minimization for Metamorphic Security Testing
Nazanin Bayati Chaleshtari, Yoann Marquer, Fabrizio Pastore +1
Although the security testing of Web systems can be automated by generating crafted inputs, solutions to automate the test oracle, i.e., vulnerability detection, remain difficult t…
Automated Test Case Repair Using Language Models
Ahmadreza Saboor Yaraghi, Darren Holden, Nafiseh Kahani +1
Ensuring the quality of software systems through testing is essential, yet maintaining test cases poses significant challenges and costs. The need for frequent updates to align wit…