20 papers
Requirements-Augmented Generation for Trustworthy Acceptance Testing of LLM-Based Software
Fanyu Wang, Chetan Arora, Zhenping Xie +4
LLM-based software (LBS) integrates large language models as core components to deliver flexible, personalised responses. Unlike traditional software with deterministic outputs, LB…
SemRF: A Semantic Reference Frame for Residual-Stream Dynamics in Language Models
Jian Gu, Aldeida Aleti, Chunyang Chen +1
Residual-stream analysis asks how language-model computation evolves across depth, but intermediate decoding requires comparable readout coordinates across layers. If embedding anc…
CodeChat-Eval: Evaluating Large Language Models in Multi-Turn Code Refinement Dialogues
Guoxiang Guo, Kla Tantithamthavorn, Neelofar Neelofar +2
Large Language Models (LLMs) are increasingly used in software engineering to generate and refine code. In practice, developers often continue from an initial code generation reque…
MORTAR: Multi-turn Metamorphic Testing for LLM-based Dialogue Systems
Aaron Guoxiang Guo, Aldeida Aleti, Neelofar Neelofar +3
With the widespread application of LLM-based dialogue systems in daily life, quality assurance has become more important than ever. Recent research has successfully introduced meth…
Trustworthy AI Software Engineers
Aldeida Aleti, Baishakhi Ray, Rashina Hoda +1
With the rapid rise of AI coding agents, the fundamental premise of what it means to be a software engineer is in question. In this vision paper, we examine what it means for an AI…
Beyond Neural Incompatibility: Cross-Scale Knowledge Transfer in Language Models through Latent Semantic Alignment
Jian Gu, Aldeida Aleti, Chunyang Chen +1
Language Models (LMs) encode substantial knowledge in their parameters, yet it remains unclear how to transfer such knowledge in a fine-grained manner, namely parametric knowledge…