7 papers
Human-Aligned Code Readability Assessment with Large Language Models
Wendkûuni C. Ouédraogo, Yinghua Li, Xueqi Dang +6
Code readability is crucial for software comprehension and maintenance, yet difficult to assess at scale. Traditional static metrics often fail to capture the subjective, context-s…
VisDocSketcher: Towards Scalable Visual Documentation with Agentic Systems
Luís F. Gomes, Xin Zhou, David Lo +1
Visual documentation is an effective tool for reducing the cognitive barrier developers face when understanding unfamiliar code, enabling more intuitive comprehension. Compared to…
Beyond Surface Similarity: Evaluating LLM-Based Test Refactorings with Structural and Semantic Awareness
Wendkûuni C. Ouédraogo, Yinghua Li, Xueqi Dang +5
Large Language Models (LLMs) are increasingly used to refactor unit tests, improving readability and structure while preserving behavior. Evaluating such refactorings, however, rem…
Rethinking Cognitive Complexity for Unit Tests: Toward a Readability-Aware Metric Grounded in Developer Perception
Wendkûuni C. Ouédraogo, Yinghua Li, Xueqi Dang +5
Automatically generated unit tests-from search-based tools like EvoSuite or LLMs-vary significantly in structure and readability. Yet most evaluations rely on metrics like Cyclomat…
CODE-DITING: A Reasoning-Based Metric for Functional Alignment in Code Evaluation
Guang Yang, Yu Zhou, Xiang Chen +5
Trustworthy evaluation methods for code snippets play a crucial role in neural code generation. Traditional methods, which either rely on reference solutions or require executable…
An LLM-as-Judge Metric for Bridging the Gap with Human Evaluation in SE Tasks
Xin Zhou, Kisub Kim, Ting Zhang +6
Large Language Models (LLMs) and other automated techniques have been increasingly used to support software developers by generating software artifacts such as code snippets, patch…