activity
20202026
most citedCodeXGLUE: A Machine Learning Benchmark Dataset for Code Understanding and Generation

416 citations · 860 across the 17 of their papers we have counts for

collaborators
Showing 2023Show all

6 papers · 1 filter

cs.CL2023★ 2 cited

Enhancing Large Language Models in Coding Through Multi-Perspective Self-Consistency

Baizhou Huang, Shuai Lu, Weizhu Chen +2

Large language models (LLMs) have exhibited remarkable ability in code generation. However, generating the correct solution in a single attempt still remains a challenge. Prior wor…

cs.CL2023

Constructing Multilingual Code Search Dataset Using Neural Machine Translation

Ryo Sekizawa, Nan Duan, Shuai Lu +1

Code search is a task to find programming codes that semantically match the given natural language queries. Even though some of the existing datasets for this task are multilingual…

cs.PL2023★ 2 cited

Code Execution with Pre-trained Language Models

Chenxiao Liu, Shuai Lu, Weizhu Chen +5

Code execution is a fundamental aspect of programming language semantics that reflects the exact behavior of the code. However, most pre-trained models for code intelligence ignore…

cs.CL2023★ 62 cited

AGIEval: A Human-Centric Benchmark for Evaluating Foundation Models

Wanjun Zhong, Ruixiang Cui, Yiduo Guo +6

Evaluating the general abilities of foundation models to tackle human-level tasks is a vital aspect of their development and application in the pursuit of Artificial General Intell…

cs.AI2023★ 9 cited

TaskMatrix.AI: Completing Tasks by Connecting Foundation Models with Millions of APIs

Yaobo Liang, Chenfei Wu, Ting Song +11

Artificial Intelligence (AI) has made incredible progress recently. On the one hand, advanced foundation models like ChatGPT can offer powerful conversation, in-context learning an…

cs.SE2023★ 2 cited

InferFix: End-to-End Program Repair with LLMs

Matthew Jin, Syed Shahriar, Michele Tufano +4

Software development life cycle is profoundly influenced by bugs: their introduction, identification, and eventual resolution account for a significant portion of software cost. Th…