activity
20242026
most citedDevEval: Evaluating Code Generation in Practical Software Projects

3 citations · 4 across the 15 of their papers we have counts for

collaborators

17 papers

cs.SE2026

Self-Spec Verifiable Code Generation

Jiaru Qian, Yihong Dong, Yongmin Li +3

Large language models (LLMs) may generate unreliable code on corner cases missed by testing, while formal verification can provide machine-checkable guarantees. Recently, researche…

cs.SE2026

PRAXIS: Graph-Grounded Tacit Knowledge for Domain Code Generation

Xue Jiang, Tianyu Zhang, Lingwei Wu +7

LLM agents have achieved strong performance on general software engineering tasks, yet struggle with domain-specific code generation. We identify the root cause as the agent's lack…

cs.CL2026

Multi-User Large Language Model Agents

Shu Yang, Shenzhe Zhu, Hao Zhu +5

Large language models (LLMs) and LLM-based agents are increasingly deployed as assistants in planning and decision making, yet most existing systems are implicitly optimized for a…

cs.CL2026

On Safety Risks in Experience-Driven Self-Evolving Agents

Weixiang Zhao, Yichen Zhang, Yingshuo Wang +8

Experience-driven self-evolution has emerged as a promising paradigm for improving the autonomy of large language model agents, yet its reliance on self-curated experience introduc…

cs.LG2026

Structural Evaluation Metrics for SVG Generation via Leave-One-Out Analysis

Haonan Zhu, Adrienne Deganutti, Elad Hirsch +1

SVG generation is typically evaluated by comparing rendered outputs to reference images, which captures visual similarity but not the structural properties that make SVG editable,…

cs.LG2026

Do Transformers Have the Ability for Periodicity Generalization?

Huanyu Liu, Ge Li, Yihong Dong +7

Large language models (LLMs) based on the Transformer have demonstrated strong performance across diverse tasks. However, current models still exhibit substantial limitations in ou…

cs.SE2026

KOCO-BENCH: Can Large Language Models Leverage Domain Knowledge in Software Development?

Xue Jiang, Ge Li, Jiaru Qian +12

Large language models (LLMs) excel at general programming but struggle with domain-specific software development, necessitating domain specialization methods for LLMs to learn and…

cs.SE2025

VulInstruct: Teaching LLMs Root-Cause Reasoning for Vulnerability Detection via Security Specifications

Hao Zhu, Jia Li, Cuiyun Gao +7

Large language models (LLMs) have achieved remarkable progress in code understanding tasks. However, they demonstrate limited performance in vulnerability detection and struggle to…

cs.SE2025

VulAgent: Hypothesis-Validation based Multi-Agent Vulnerability Detection

Ziliang Wang, Ge Li, Jia Li +2

The application of language models to project-level vulnerability detection remains challenging, owing to the dual requirement of accurately localizing security-sensitive code and…

cs.SE2025

Computational Thinking Reasoning in Large Language Models

Kechi Zhang, Ge Li, Jia Li +8

While large language models (LLMs) have demonstrated remarkable reasoning capabilities, they often struggle with complex tasks that require specific thinking paradigms, such as div…

cs.LG2025

SATURN: SAT-based Reinforcement Learning to Unleash LLMs Reasoning

Huanyu Liu, Ge Li, Jia Li +3

How to design reinforcement learning (RL) tasks that effectively unleash the reasoning capability of large language models (LLMs) remains an open question. Existing RL tasks (e.g.,…

cs.SE2025

aiXcoder-7B-v2: Training LLMs to Fully Utilize the Long Context in Repository-level Code Completion

Jia Li, Hao Zhu, Huanyu Liu +7

Large Language Models (LLMs) have shown promising results in repository-level code completion, which completes code based on the in-file and cross-file context of a repository. The…

cs.CL2025

Reasoning is Periodicity? Improving Large Language Models Through Effective Periodicity Modeling

Yihong Dong, Ge Li, Xue Jiang +8

Periodicity, as one of the most important basic characteristics, lays the foundation for facilitating structured knowledge acquisition and systematic cognitive processes within hum…

cs.CL2024

Generating Equivalent Representations of Code By A Self-Reflection Approach

Jia Li, Ge Li, Lecheng Wang +2

Equivalent Representations (ERs) of code are textual representations that preserve the same semantics as the code itself, e.g., natural language comments and pseudocode. ERs play a…

cs.CL2024★ 1 cited

aiXcoder-7B: A Lightweight and Effective Large Language Model for Code Processing

Siyuan Jiang, Jia Li, He Zong +11

Large Language Models (LLMs) have been widely used in code completion, and researchers are focusing on scaling up LLMs to improve their accuracy. However, larger LLMs have lower in…

cs.CL2024

DevEval: A Manually-Annotated Code Generation Benchmark Aligned with Real-World Code Repositories

Jia Li, Ge Li, Yunfei Zhao +15

How to evaluate the coding abilities of Large Language Models (LLMs) remains an open question. We find that existing benchmarks are poorly aligned with real-world code repositories…

cs.SE2024★ 3 cited

DevEval: Evaluating Code Generation in Practical Software Projects

Jia Li, Ge Li, Yunfei Zhao +14

How to evaluate Large Language Models (LLMs) in code generation is an open question. Many benchmarks have been proposed but are inconsistent with practical software projects, e.g.,…