most citedDevEval: Evaluating Code Generation in Practical Software Projects

3 citations · 8 across the 6 of their papers we have counts for

collaborators
Showing cs.SEShow all

5 papers · 1 filter

cs.SE2025

Can Large Language Models Reason About Complex Execution Paths? An Empirical Study on Python

Wenhan Wang, Kaibo Liu, Zeyu Sun +4

Execution path reasoning is a key step towards program semantics understanding. It is crucial for generating test cases that cover certain branches/paths, or detecting bugs that ar…

cs.SE2024★ 1 cited

Python Symbolic Execution with LLM-powered Code Generation

Wenhan Wang, Kaibo Liu, An Ran Chen +4

Symbolic execution is a key technology in software testing, which generates test cases by collecting symbolic path constraints and then solving constraints with SMT solvers. Symbol…

cs.SE2024★ 1 cited

HITS: High-coverage LLM-based Unit Test Generation via Method Slicing

Zejun Wang, Kaibo Liu, Ge Li +1

Large language models (LLMs) have behaved well in generating unit tests for Java projects. However, the performance for covering the complex focal methods within the projects is po…

cs.SE2024★ 3 cited

LLM-Powered Test Case Generation for Detecting Bugs in Plausible Programs

Kaibo Liu, Zhenpeng Chen, Yiyang Liu +7

Detecting tricky bugs in plausible programs, those that pass existing test suites yet still contain bugs, remains a significant challenge in software testing. To address this probl…

cs.SE2024★ 3 cited

DevEval: Evaluating Code Generation in Practical Software Projects

Jia Li, Ge Li, Yunfei Zhao +14

How to evaluate Large Language Models (LLMs) in code generation is an open question. Many benchmarks have been proposed but are inconsistent with practical software projects, e.g.,…