4 papers
Search-based Selection of Metamorphic Relations for Optimized Robustness Testing of Large Language Models
Sangwon Hyun, Shaukat Ali, M. Ali Babar
Assessing the trustworthiness of Large Language Models (LLMs), such as robustness, has garnered significant attention. Recently, metamorphic testing that defines Metamorphic Relati…
DDPT: Diffusion-Driven Prompt Tuning for Large Language Model Code Generation
Jinyang Li, Sangwon Hyun, M. Ali Babar
Large Language Models (LLMs) have demonstrated remarkable capabilities in code generation. However, the quality of the generated code is heavily dependent on the structure and comp…
METAL: Metamorphic Testing Framework for Analyzing Large-Language Model Qualities
Sangwon Hyun, Mingyu Guo, M. Ali Babar
Large-Language Models (LLMs) have shifted the paradigm of natural language data processing. However, their black-boxed and probabilistic characteristics can lead to potential risks…
Alert-ME: An Explainability-Driven Defense Against Adversarial Examples in Transformer-Based Text Classification
Bushra Sabir, Yansong Gao, Alsharif Abuadbba +1
Transformer-based text classifiers such as BERT, RoBERTa, T5, and GPT have shown strong performance in natural language processing tasks but remain vulnerable to adversarial exampl…