most citedCoderEval: A Benchmark of Pragmatic Code Generation with Generative Pre-trained Models

27 citations · 34 across the 5 of their papers we have counts for

collaborators

5 papers

cs.SE2024★ 2 cited

On the Evaluation of Large Language Models in Unit Test Generation

Lin Yang, Chen Yang, Shutao Gao +8

Unit testing is an essential activity in software development for verifying the correctness of software components. However, manually writing unit tests is challenging and time-con…

cs.CR2023★ 2 cited

CompVPD: Iteratively Identifying Vulnerability Patches Based on Human Validation Results with a Precise Context

Tianyu Chen, Lin Li, Taotao Qian +6

Applying security patches in open source software timely is critical for ensuring the security of downstream applications. However, it is challenging to apply these patches promptl…

cs.CR2023★ 3 cited

VulLibGen: Generating Names of Vulnerability-Affected Packages via a Large Language Model

Tianyu Chen, Lin Li, Liuchuan Zhu +5

Security practitioners maintain vulnerability reports (e.g., GitHub Advisory) to help developers mitigate security risks. An important task for these databases is automatically ext…

cs.CR2023

Identifying Vulnerable Third-Party Java Libraries from Textual Descriptions of Vulnerabilities and Libraries

Tianyu Chen, Lin Li, Bingjie Shan +4

To address security vulnerabilities arising from third-party libraries, security researchers maintain databases monitoring and curating vulnerability reports. Application developer…

cs.SE2023★ 27 cited

CoderEval: A Benchmark of Pragmatic Code Generation with Generative Pre-trained Models

Hao Yu, Bo Shen, Dezhi Ran +7

Code generation models based on the pre-training and fine-tuning paradigm have been increasingly attempted by both academia and industry, resulting in well-known industrial models…