184 citations · 455 across the 23 of their papers we have counts for
5 papers · 1 filter
Large Language Models in Fault Localisation
Yonghao Wu, Zheng Li, Jie M. Zhang +3
Large Language Models (LLMs) have shown promise in multiple software engineering tasks including code generation, program repair, code summarisation, and test generation. Fault loc…
COCO: Testing Code Generation Systems via Concretized Instructions
Ming Yan, Junjie Chen, Jie M. Zhang +3
Code generation systems have been extensively developed in recent years to generate source code based on natural language instructions. However, despite their advancements, these s…
An Empirical Study of the Non-determinism of ChatGPT in Code Generation
Shuyin Ouyang, Jie M. Zhang, Mark Harman +1
There has been a recent explosion of research on Large Language Models (LLMs) for software engineering tasks, in particular code generation. However, results from LLMs can be highl…
Fairness Improvement with Multiple Protected Attributes: How Far Are We?
Zhenpeng Chen, Jie M. Zhang, Federica Sarro +1
Existing research mostly improves the fairness of Machine Learning (ML) software regarding a single protected attribute at a time, but this is unrealistic given that many users hav…
Simulation-Driven Automated End-to-End Test and Oracle Inference
Shreshth Tuli, Kinga Bojarczuk, Natalija Gucevska +3
This is the first work to report on inferential testing at scale in industry. Specifically, it reports the experience of automated testing of integrity systems at Meta. We built an…