4 papers
Repository-Aware Metamorphic Relation Generation for Augmented Reality Applications using Large Language Models
Dibyendu Brinto Bose, Jiawei Qin, Chris Brown
Metamorphic Testing (MT) provides a promising approach for testing software without defined test oracles by specifying expected relations between inputs and outputs, instead of rel…
Beyond Code Snippets: Benchmarking LLMs on Repository-Level Question Answering
Yoseph Berhanu Alebachew, Hunter Leary, Swanand Vaishampayan +1
Large Language Models (LLMs) have shown impressive capabilities across software engineering tasks, including question answering (QA). However, most studies and benchmarks focus on…
Automatic Bias Detection in Source Code Review
Yoseph Berhanu Alebachew, Chris Brown
Bias is an inherent threat to human decision-making, including in decisions made during software development. Extensive research has demonstrated the presence of biases at various…
Are We on the Same Page? Examining Developer Perception Alignment in Open Source Code Reviews
Yoseph Berhanu Alebachew, Minhyuk Ko, Chris Brown
Code reviews are a critical aspect of open-source software (OSS) development, ensuring quality and fostering collaboration. This study examines perceptions, challenges, and biases…