activity
20242026
most citedA Survey on Evaluating Large Language Models in Code Generation Tasks

11 citations · 15 across the 12 of their papers we have counts for

collaborators
Showing cs.SEShow all

10 papers · 1 filter

cs.SE2026

AttnCompress: Dynamic Attention-Guided Trajectory Compression for Software Engineering Agents

Zhengran Zeng, Yixin Li, Rui Xie +2

The transition from human-centric assistance to Autonomous Software Engineering (ASE) agents has enabled the resolution of complex real-world SE tasks. However, the trial-and-error…

cs.SE2026

GALA: Multimodal Graph Alignment for Bug Localization in Automated Program Repair

Zhuoyao Liu, Zhengran Zeng, Shu-Dong Huang +3

Large Language Model (LLM)-based Automated Program Repair (APR) has shown strong potential on textual benchmarks, yet struggles in multimodal scenarios where bugs are reported with…

cs.SE2026

An Empirical Study on Influence-Based Pretraining Data Selection for Code Large Language Models

Chengli Xing, Zhengran Zeng, Gexiang Fang +3

Recent advancements in code large language models (Code-LLMs) have demonstrated remarkable capabilities in resolving programming related tasks. Meanwhile, researchers have recogniz…

cs.SE2025

Benchmarking and Studying the LLM-based Agent System in End-to-End Software Development

Zhengran Zeng, Yixin Li, Rui Xie +2

The development of LLM-based autonomous agents for end-to-end software development represents a significant paradigm shift in software engineering. However, the scientific evaluati…

cs.SE2025

SWR-Bench: Assessing LLM Performance in Real-World Code Review Comment Generation

Zhengran Zeng, Ruikai Shi, Keke Han +7

Automated Code Review (ACR) is crucial for software quality, yet existing benchmarks often fail to reflect real-world complexities, hindering the evaluation of modern Large Languag…

cs.SE2025★ 1 cited

Seed&Steer: Guiding Large Language Models with Compilable Prefix and Branch Signals for Unit Test Generation

Shuaiyu Zhou, Zhengran Zeng, Xiaoling Zhou +3

Unit tests play a vital role in the software development lifecycle. Recent advances in Large Language Model (LLM)-based approaches have significantly improved automated test genera…

cs.SE2024

ISC4DGF: Enhancing Directed Grey-box Fuzzing with LLM-Driven Initial Seed Corpus Generation

Yijiang Xu, Hongrui Jia, Liguo Chen +8

Fuzz testing is crucial for identifying software vulnerabilities, with coverage-guided grey-box fuzzers like AFL and Angora excelling in broad detection. However, as the need for t…

cs.SE2024★ 11 cited

A Survey on Evaluating Large Language Models in Code Generation Tasks

Liguo Chen, Qi Guo, Hongrui Jia +9

This paper provides a comprehensive review of the current methods and metrics used to evaluate the performance of Large Language Models (LLMs) in code generation tasks. With the ra…

cs.SE2024

CoderUJB: An Executable and Unified Java Benchmark for Practical Programming Scenarios

Zhengran Zeng, Yidong Wang, Rui Xie +2

In the evolving landscape of large language models (LLMs) tailored for software engineering, the need for benchmarks that accurately reflect real-world development scenarios is par…

cs.SE2024★ 2 cited

CodeShell Technical Report

Rui Xie, Zhengran Zeng, Zhuohao Yu +3

Code large language models mark a pivotal breakthrough in artificial intelligence. They are specifically crafted to understand and generate programming languages, significantly boo…