4 papers · 1 filter
Experimental Analysis of Productive Interaction Strategy with ChatGPT: User Study on Function and Project-level Code Generation Tasks
Sangwon Hyun, Hyunjun Kim, Jinhyuk Jang +2
The application of Large Language Models (LLMs) is growing in the productive completion of Software Engineering tasks. Yet, studies investigating productive prompting techniques of…
Search-based Selection of Metamorphic Relations for Optimized Robustness Testing of Large Language Models
Sangwon Hyun, Shaukat Ali, M. Ali Babar
Assessing the trustworthiness of Large Language Models (LLMs), such as robustness, has garnered significant attention. Recently, metamorphic testing that defines Metamorphic Relati…
DDPT: Diffusion-Driven Prompt Tuning for Large Language Model Code Generation
Jinyang Li, Sangwon Hyun, M. Ali Babar
Large Language Models (LLMs) have demonstrated remarkable capabilities in code generation. However, the quality of the generated code is heavily dependent on the structure and comp…
METAL: Metamorphic Testing Framework for Analyzing Large-Language Model Qualities
Sangwon Hyun, Mingyu Guo, M. Ali Babar
Large-Language Models (LLMs) have shifted the paradigm of natural language data processing. However, their black-boxed and probabilistic characteristics can lead to potential risks…