25 citations · 44 across the 3 of their papers we have counts for
3 papers
cs.SE2023
Recommending Analogical APIs via Knowledge Graph Embedding
Mingwei Liu, Yanjun Yang, Yiling Lou +4
Library migration, which re-implements the same software behavior by using a different library instead of using the current one, has been widely observed in software evolution. One…
cs.CL2023★ 25 cited
ClassEval: A Manually-Crafted Benchmark for Evaluating LLMs on Class-level Code Generation
Xueying Du, Mingwei Liu, Kaixin Wang +7
In this work, we make the first attempt to evaluate LLMs in a more challenging code generation scenario, i.e. class-level code generation. We first manually construct the first cla…
cs.CL2023★ 19 cited
Evaluating Instruction-Tuned Large Language Models on Code Comprehension and Generation
Zhiqiang Yuan, Junwei Liu, Qiancheng Zi +3
In this work, we evaluate 10 open-source instructed LLMs on four representative code comprehension and generation tasks. We have the following main findings. First, for the zero-sh…