4 papers
Model Context Protocol (MCP) at First Glance: Studying the Security and Maintainability of MCP Servers
Mohammed Mehedi Hasan, Hao Li, Emad Fallahzadeh +3
Although Foundation Models (FMs), such as GPT-4, are increasingly used in domains like finance and software engineering, reliance on textual interfaces limits these models' real-wo…
An Empirical Study of Testing Practices in Open Source AI Agent Frameworks and Agentic Applications
Mohammed Mehedi Hasan, Hao Li, Emad Fallahzadeh +3
Foundation model (FM)-based AI agents are rapidly gaining adoption across diverse domains, but their inherent non-determinism and non-reproducibility pose testing and quality assur…
HAFix: History-Augmented Large Language Models for Bug Fixing
Yu Shi, Abdul Ali Bangash, Emad Fallahzadeh +2
Recent studies have explored the performance of Large Language Models (LLMs) on various Software Engineering (SE) tasks, such as code generation and bug fixing. However, these appr…
Assessing and Improving the Representativeness of Code Generation Benchmarks Using Knowledge Units (KUs) of Programming Languages -- An Empirical Study
Md Ahasanuzzaman, Bram Adams, Emad Fallahzadeh +2
Large Language Models (LLMs) such as GPT-4, Claude and LLaMA have shown impressive performance in code generation, typically evaluated using benchmarks (e.g., HumanEval). However,…