5 papers
A Metamorphic Testing Approach to Diagnosing Memorization in LLM-Based Program Repair
Milan De Koning, Ali Asgari, Pouria Derakhshanfar +1
LLM-based automated program repair (APR) techniques have shown promising results in reducing debugging costs. However, prior results can be affected by data leakage: large language…
What Challenges Do Developers Face in AI Agent Systems? An Empirical Study on Stack Overflow & GitHub Issues
Ali Asgari, Annibale Panichella, Pouria Derakhshanfar +1
AI Agents have rapidly gained prominence in both research and industry as systems that extend large language models with planning, tool use, memory, and goal-directed action. Despi…
Metamorphic Testing of Deep Code Models: A Systematic Literature Review
Ali Asgari, Milan de Koning, Pouria Derakhshanfar +1
Large language models and deep learning models designed for code intelligence have revolutionized the software engineering field due to their ability to perform various code-relate…
Test Wars: A Comparative Study of SBST, Symbolic Execution, and LLM-Based Approaches to Unit Test Generation
Azat Abdullin, Pouria Derakhshanfar, Annibale Panichella
Generating tests automatically is a key and ongoing area of focus in software engineering research. The emergence of Large Language Models (LLMs) has opened up new opportunities, g…
RefExpo: Unveiling Software Project Structures through Advanced Dependency Graph Extraction
Vahid Haratian, Pouria Derakhshanfar, Vladimir Kovalenko +1
The dependency graph (DG) of a software project offers valuable insights for identifying its key components and has been leveraged in numerous studies. However, there is a lack of…