9 papers
Test-Driven Approaches to Software Engineering with Large Language Models: A Survey of Phases, Tasks, and Agent Skills
Yunhao Liang, Chengguang Gan, Ruixuan Ying +3
Tests increasingly participate in the decisions made by large language models and software engineering agents. They specify intended behavior, guide program construction and repair…
Correct Tests Are Not Enough: Measuring and Training Oracle Conversion in Specification-Based Test Generation
Yunhao Liang, Chengguang Gan, Ruixuan Ying +3
Generating tests from a natural-language specification requires both an input that exposes faulty behavior and a correct expected output. These requirements need not improve togeth…
Auditing and Decomposing Feedback-Driven Evolution in LLM Test Generation under the Oracle Problem
Yunhao Liang, Chengguang Gan, Ruixuan Ying +3
Execution feedback is often treated as a self-verifying signal for improving LLM-generated tests. However, when generated inputs are executed on a single accepted program and its o…
Security Tests as Executable Specifications for LLM Code Generation: Benefits, Trade-offs, and Coverage Limits
Yunhao Liang, Chengguang Gan, Ruixuan Ying +3
Large language models (LLMs) can generate functionally useful code that remains vulnerable, while security-focused interventions may break intended behavior. We investigate securit…
Do Code Language Models Follow Tests? Paired Interventions on Program Behavior
Yunhao Liang, Chengguang Gan, Ruixuan Ying +3
Visible tests specify concrete program behavior, but an improvement in benchmark accuracy does not establish that a model follows the rule expressed by those tests. We study test u…
Scaling Test-Driven Code Generation from Functions to Classes: An Empirical Study
Yunhao Liang, Ruixuan Ying, Shiwen Ni +1
Test-driven development (TDD) has been adopted to improve Large Language Model (LLM)-based code generation by using tests as executable specifications. However, existing TDD-style…