20 citations · 31 across the 12 of their papers we have counts for
4 papers · 1 filter
Towards Evaluation Engineering: An Empirical Study of ML Evaluation Harnesses in the Wild
Zhimin Zhao, Zehao Wang, Abdul Ali Bangash +2
Evaluation harnesses are software systems that orchestrate model evaluation by managing model invocation, data loading, metric computation, and result reporting. Despite their crit…
On the Footprints of Reviewer Bots Feedback on Agentic Pull Requests in OSS GitHub Repositories
Syeda Kaneez Fatima, Yousuf Abrar, Abdul Rehman Tahir +3
Autonomous coding agents are reshaping software development by creating pull requests (PRs) on GitHub, referred to as agentic PRs. In parallel, the review process is also becoming…
Reliability of AI Bots Footprints in GitHub Actions CI/CD Workflows
Syed Muhammad Ashhar Shah, Sehrish Habib, Muizz Hussain +2
Continuous Integration and Deployment (CI/CD) workflows are central to modern software delivery, yet the reliability of agentic AI bots operating within these workflows remain unde…
Novice Developers Produce Larger Review Overhead for Project Maintainers while Vibe Coding
Syed Ammar Asdaque, Imran Haider, Muhammad Umar Malik +2
AI coding agents allow software developers to generate code quickly, which raises a practical question for project managers and open source maintainers: can vibe coders with less d…