8 papers
A Structured Approach to Safety Case Construction for AI Systems
Sung Une Lee, Liming Zhu, Md Shamsujjoha +4
Safety cases, structured arguments that a system is acceptably safe, are becoming central to the governance of AI systems. Yet, traditional safety-case practices from aviation or n…
SWE-ABS: Adversarial Benchmark Strengthening Exposes Inflated Success Rates on Test-based Benchmark
Boxi Yu, Yang Cao, Yuzhong Zhang +9
The SWE-Bench Verified leaderboard is approaching saturation, with the top system achieving 78.80%. However, we show that this performance is inflated. Our re-evaluation reveals th…
Fuzzing-based Mutation Testing of C/C++ Software in Cyber-Physical Systems
Jaekwon Lee, Fabrizio Pastore, Lionel Briand
Mutation testing can help minimize the delivery of faulty software. Therefore, it is a recommended practice for developing embedded software in safety-critical cyber-physical syste…
Search-based DNN Testing and Retraining with GAN-enhanced Simulations
Mohammed Oualid Attaoui, Fabrizio Pastore, Lionel Briand
In safety-critical systems (e.g., autonomous vehicles and robots), Deep Neural Networks (DNNs) are becoming a key component for computer vision tasks, particularly semantic segment…
Automated Test Case Repair Using Language Models
Ahmadreza Saboor Yaraghi, Darren Holden, Nafiseh Kahani +1
Ensuring the quality of software systems through testing is essential, yet maintaining test cases poses significant challenges and costs. The need for frequent updates to align wit…
System Safety Monitoring of Learned Components Using Temporal Metric Forecasting
Sepehr Sharifi, Andrea Stocco, Lionel C. Briand
In learning-enabled autonomous systems, safety monitoring of learned components is crucial to ensure their outputs do not lead to system safety violations, given the operational co…