activity
20232025
most citedCodeScore: Evaluating Code Generation by Learning Code Execution

10 citations · 14 across the 5 of their papers we have counts for

collaborators

5 papers

cs.CL2025

Reasoning is Periodicity? Improving Large Language Models Through Effective Periodicity Modeling

Yihong Dong, Ge Li, Xue Jiang +8

Periodicity, as one of the most important basic characteristics, lays the foundation for facilitating structured knowledge acquisition and systematic cognitive processes within hum…

cs.CL2024★ 1 cited

aiXcoder-7B: A Lightweight and Effective Large Language Model for Code Processing

Siyuan Jiang, Jia Li, He Zong +11

Large Language Models (LLMs) have been widely used in code completion, and researchers are focusing on scaling up LLMs to improve their accuracy. However, larger LLMs have lower in…

cs.CL2024

DevEval: A Manually-Annotated Code Generation Benchmark Aligned with Real-World Code Repositories

Jia Li, Ge Li, Yunfei Zhao +15

How to evaluate the coding abilities of Large Language Models (LLMs) remains an open question. We find that existing benchmarks are poorly aligned with real-world code repositories…

cs.SE2024★ 3 cited

DevEval: Evaluating Code Generation in Practical Software Projects

Jia Li, Ge Li, Yunfei Zhao +14

How to evaluate Large Language Models (LLMs) in code generation is an open question. Many benchmarks have been proposed but are inconsistent with practical software projects, e.g.,…

cs.SE2023★ 10 cited

CodeScore: Evaluating Code Generation by Learning Code Execution

Yihong Dong, Jiazheng Ding, Xue Jiang +3

A proper code evaluation metric (CEM) profoundly impacts the evolution of code generation, which is an important research field in NLP and software engineering. Prevailing match-ba…