8 papers
CASPER-Change-Aware Slice Prioritization for Efficient Regression Testing of LLM-based systems
Biruk Asmare Muse, Lionel Briand, Yiwei Lu +1
Regression testing for LLM-based systems poses unique challenges because individual regression instances provide limited information about system-level regressions. A failure in a…
Towards Imputation of Pre-Trained Language Model Metadata using Semantic Fingerprinting
Adekunle Ajibode, Oussama Ben Sghaier, Keheliya Gallaba +2
Pre-trained language models (PTLMs) hosted on platforms such as Hugging Face form complex lineage structures similar to software dependency graphs. However, unlike traditional soft…
Beyond Accuracy: Behavioral Dynamics of Agentic Multi-Hunk Repair
Noor Nashid, Daniel Ding, Keheliya Gallaba +2
Automated program repair has traditionally focused on single-hunk defects, overlooking multi-hunk bugs that are prevalent in real-world systems. Repairing these bugs requires coord…
Towards Reliable Generation of Executable Workflows by Foundation Models
Sogol Masoumzadeh, Keheliya Gallaba, Dayi Lin +1
Recent advancements in Foundation Models (FMs) have demonstrated significant progress in processing complex natural language to perform intricate tasks. Successfully executing thes…
Building an Open AIBOM Standard in the Wild
Gopi Krishnan Rajbahadur, Keheliya Gallaba, Elyas Rashno +4
Modern software engineering increasingly relies on open, community-driven standards, yet how such standards are created in fast-evolving domains like AI-powered systems remains und…
Characterizing Multi-Hunk Patches: Divergence, Proximity, and LLM Repair Challenges
Noor Nashid, Daniel Ding, Keheliya Gallaba +2
Multi-hunk bugs, where fixes span disjoint regions of code, are common in practice, yet remain underrepresented in automated repair. Existing techniques and benchmarks pre-dominant…