13 papers
LLM-Driven Cost-Effective Requirements Change Impact Analysis
Romina Etezadi, Sallam Abualhaija, Chetan Arora +1
Requirements are inherently subject to changes throughout the software development lifecycle. Within the limited budget available to requirements engineers, manually identifying th…
Mining Workflow Graphs for Black-Box Boundary Testing of Conversational LLM Agents
Liting Lin, Boxi Yu, Yuzhong Zhang +3
Conversational LLM agents can cause real-world harm when their internal workflows fail, such as completing a transaction without confirmation. Testing these state-dependent failure…
EvoEye: Self-Evolving Runtime Monitoring for Autonomous Driving Systems
Mingfei Cheng, Lionel Briand, Xiaofei Xie
Runtime monitoring is essential for detecting impending hazards in autonomous driving systems (ADSs). However, existing ADS runtime monitors have fixed detection capabilities: rule…
LLM-based Mockless Unit Test Generation for Java
Qinghua Xu, Guancheng Wang, Lionel Briand +2
Large language models (LLMs) have shown strong potential for automated test generation, yet most approaches to generating Java unit tests still rely on mocking frameworks to handle…
Supporting System Testing with a Multi-Agent LLM-based Framework for Knowledge Graph Extraction: A Case Study with Ethernet Switch Systems
Rongqi Pan, Mahboubeh Dadkhah, Jean Baptiste Minani +3
Technical documents contain rich domain knowledge for automating downstream tasks such as system testing. While this paper focuses on Ethernet switch configuration manuals (ESCMs),…
Constrained Co-evolutionary Metamorphic Differential Testing for Autonomous Systems with an Interpretability Approach
Hossein Yousefizadeh, Shenghui Gu, Lionel C. Briand +1
Autonomous systems, such as autonomous driving systems, evolve rapidly through frequent updates, risking unintended behavioral degradations. Effective system-level testing is chall…