10 papers
The State of the SBOM Tool Ecosystems: A Comparative Analysis of SPDX and CycloneDX
Zhimin Zhao, Abdul Ali Bangash, Tongxu Ge +3
Software Bills of Materials (SBOMs) improve software release transparency by documenting components and dependencies, but their practical value depends on the tools that generate,…
Towards Evaluation Engineering: An Empirical Study of ML Evaluation Harnesses in the Wild
Zhimin Zhao, Zehao Wang, Abdul Ali Bangash +2
Evaluation harnesses are software systems that orchestrate model evaluation by managing model invocation, data loading, metric computation, and result reporting. Despite their crit…
On the Footprints of Reviewer Bots Feedback on Agentic Pull Requests in OSS GitHub Repositories
Syeda Kaneez Fatima, Yousuf Abrar, Abdul Rehman Tahir +3
Autonomous coding agents are reshaping software development by creating pull requests (PRs) on GitHub, referred to as agentic PRs. In parallel, the review process is also becoming…
Reliability of AI Bots Footprints in GitHub Actions CI/CD Workflows
Syed Muhammad Ashhar Shah, Sehrish Habib, Muizz Hussain +2
Continuous Integration and Deployment (CI/CD) workflows are central to modern software delivery, yet the reliability of agentic AI bots operating within these workflows remain unde…
Novice Developers Produce Larger Review Overhead for Project Maintainers while Vibe Coding
Syed Ammar Asdaque, Imran Haider, Muhammad Umar Malik +2
AI coding agents allow software developers to generate code quickly, which raises a practical question for project managers and open source maintainers: can vibe coders with less d…
HAFix: History-Augmented Large Language Models for Bug Fixing
Yu Shi, Abdul Ali Bangash, Emad Fallahzadeh +2
Recent studies have explored the performance of Large Language Models (LLMs) on various Software Engineering (SE) tasks, such as code generation and bug fixing. However, these appr…