activity
20212024
most citedCodeXGLUE: A Machine Learning Benchmark Dataset for Code Understanding and Generation

416 citations · 493 across the 12 of their papers we have counts for

collaborators
Showing cs.SEShow all

9 papers · 1 filter

cs.SE2023

SUT: Active Defects Probing for Transcompiler Models

Mengnan Qi, Yufan Huang, Maoquan Wang +5

Automatic Program translation has enormous application value and hence has been attracting significant interest from AI researchers. However, we observe that current program transl…

cs.SE2023

Program Translation via Code Distillation

Yufan Huang, Mengnan Qi, Yongqiang Yao +4

Software version migration and program translation are an important and costly part of the lifecycle of large codebases. Traditional machine translation relies on parallel corpora…

cs.SE2023★ 4 cited

Predicting Code Coverage without Execution

Michele Tufano, Shubham Chandel, Anisha Agarwal +2

Code coverage is a widely used metric for quantifying the extent to which program elements, such as statements or branches, are executed during testing. Calculating code coverage i…

cs.SE2022★ 4 cited

Execution-based Evaluation for Data Science Code Generation Models

Junjie Huang, Chenglong Wang, Jipeng Zhang +6

Code generation models can benefit data scientists' productivity by automatically generating code from context and text descriptions. An important measure of the modeling progress…

cs.SE2022★ 11 cited

Exploring and Evaluating Personalized Models for Code Generation

Andrei Zlotchevski, Dawn Drain, Alexey Svyatkovskiy +3

Large Transformer models achieved the state-of-the-art status for Natural Language Understanding tasks and are increasingly becoming the baseline model architecture for modeling so…

cs.SE2022★ 1 cited

DeepPERF: A Deep Learning-Based Approach For Improving Software Performance

Spandan Garg, Roshanak Zilouchian Moghaddam, Colin B. Clement +2

Improving software performance is an important yet challenging part of the software development cycle. Today, the majority of performance inefficiencies are identified and patched…

cs.SE2022

Generating Examples From CLI Usage: Can Transformers Help?

Roshanak Zilouchian Moghaddam, Spandan Garg, Colin B. Clement +2

Continuous evolution in modern software often causes documentation, tutorials, and examples to be out of sync with changing interfaces and frameworks. Relying on outdated documenta…

cs.SE2022★ 37 cited

Learning to Reduce False Positives in Analytic Bug Detectors

Anant Kharkar, Roshanak Zilouchian Moghaddam, Matthew Jin +4

Due to increasingly complex software design and rapid iterative development, code defects and security vulnerabilities are prevalent in modern software. In response, programmers re…

cs.SE2021★ 416 cited

CodeXGLUE: A Machine Learning Benchmark Dataset for Code Understanding and Generation

Shuai Lu, Daya Guo, Shuo Ren +19

Benchmark datasets have a significant impact on accelerating research in programming language tasks. In this paper, we introduce CodeXGLUE, a benchmark dataset to foster machine le…