activity
20192025
most citedNo More Manual Tests? Evaluating and Improving ChatGPT for Unit Test Generation

55 citations · 118 across the 12 of their papers we have counts for

collaborators
Showing 2023Show all

5 papers · 1 filter

cs.SE2023

Recommending Analogical APIs via Knowledge Graph Embedding

Mingwei Liu, Yanjun Yang, Yiling Lou +4

Library migration, which re-implements the same software behavior by using a different library instead of using the current one, has been widely observed in software evolution. One…

cs.CL2023★ 25 cited

ClassEval: A Manually-Crafted Benchmark for Evaluating LLMs on Class-level Code Generation

Xueying Du, Mingwei Liu, Kaixin Wang +7

In this work, we make the first attempt to evaluate LLMs in a more challenging code generation scenario, i.e. class-level code generation. We first manually construct the first cla…

cs.CL2023★ 19 cited

Evaluating Instruction-Tuned Large Language Models on Code Comprehension and Generation

Zhiqiang Yuan, Junwei Liu, Qiancheng Zi +3

In this work, we evaluate 10 open-source instructed LLMs on four representative code comprehension and generation tasks. We have the following main findings. First, for the zero-sh…

cs.SE2023★ 55 cited

No More Manual Tests? Evaluating and Improving ChatGPT for Unit Test Generation

Zhiqiang Yuan, Yiling Lou, Mingwei Liu +4

Unit testing is essential in detecting bugs in functionally-discrete program units. Manually writing high-quality unit tests is time-consuming and laborious. Although traditional t…

cs.SE2023★ 2 cited

KNOD: Domain Knowledge Distilled Tree Decoder for Automated Program Repair

Nan Jiang, Thibaud Lutellier, Yiling Lou +3

Automated Program Repair (APR) improves software reliability by generating patches for a buggy program automatically. Recent APR techniques leverage deep learning (DL) to build mod…