4 papers
Test Case Selection for Deep Neural Networks: A Replication Study on LLMs for Code
Ali Asgari, Mitchell Olsthoorn, Annibale Panichella
Recently, test case selection (TCS) techniques have been explored to support the operational evaluation of deep neural networks (DNNs) under limited testing budgets, where labeling…
A Metamorphic Testing Approach to Diagnosing Memorization in LLM-Based Program Repair
Milan De Koning, Ali Asgari, Pouria Derakhshanfar +1
LLM-based automated program repair (APR) techniques have shown promising results in reducing debugging costs. However, prior results can be affected by data leakage: large language…
What Challenges Do Developers Face in AI Agent Systems? An Empirical Study on Stack Overflow & GitHub Issues
Ali Asgari, Annibale Panichella, Pouria Derakhshanfar +1
AI Agents have rapidly gained prominence in both research and industry as systems that extend large language models with planning, tool use, memory, and goal-directed action. Despi…
Metamorphic Testing of Deep Code Models: A Systematic Literature Review
Ali Asgari, Milan de Koning, Pouria Derakhshanfar +1
Large language models and deep learning models designed for code intelligence have revolutionized the software engineering field due to their ability to perform various code-relate…