activity
20232026
most citedCan LLMs Replace Human Evaluators? An Empirical Study of LLM-as-a-Judge in Software Engineering

54 citations · 61 across the 8 of their papers we have counts for

collaborators
Showing cs.SEShow all

9 papers · 1 filter

cs.SE2026

VulnGym: Benchmarking Coding Agents for Repository-Level Vulnerability Detection

Kexing Ji, Jiachen Liu, Enze Hu +7

Recent advances in LLM-based vulnerability detection have shown promising results, while coding agents further extend this capability from isolated code snippets to complete reposi…

cs.SE2026

Unseen-Codebases-Domain Data Synthesis and Training Based on Code Graphs

Guangsheng Ou, Qiming Zhang, Sirong Chen +9

In the context of newly release software frameworks, large language models (LLMs) often exhibit poor performance and a high rate of hallucination, as they are not exposed to such e…

cs.SE2025

An Empirical Study of Knowledge Distillation for Code Understanding Tasks

Ruiqi Wang, Zezhou Yang, Cuiyun Gao +2

Pre-trained language models (PLMs) have emerged as powerful tools for code understanding. However, deploying these PLMs in large-scale applications faces practical challenges due t…

cs.SE2025★ 54 cited

Can LLMs Replace Human Evaluators? An Empirical Study of LLM-as-a-Judge in Software Engineering

Ruiqi Wang, Jiyu Guo, Cuiyun Gao +3

Recently, large language models (LLMs) have been deployed to tackle various software engineering (SE) tasks like code generation, significantly advancing the automation of SE tasks…

cs.SE2025★ 1 cited

An Empirical Study of Retrieval-Augmented Code Generation: Challenges and Opportunities

Zezhou Yang, Sirong Chen, Cuiyun Gao +4

Code generation aims to automatically generate code snippets of specific programming language according to natural language descriptions. The continuous advancements in deep learni…

cs.SE2024★ 3 cited

The Current Challenges of Software Engineering in the Era of Large Language Models

Cuiyun Gao, Xing Hu, Shan Gao +2

With the advent of large language models (LLMs) in the artificial intelligence (AI) area, the field of software engineering (SE) has also witnessed a paradigm shift. These models,…