34 citations · 89 across the 8 of their papers we have counts for
4 papers · 1 filter
ReCode: Robustness Evaluation of Code Generation Models
Shiqi Wang, Zheng Li, Haifeng Qian +11
Code generation models have achieved impressive performance. However, they tend to be brittle as slight edits to a prompt could lead to very different generations; these robustness…
CoCoMIC: Code Completion By Jointly Modeling In-file and Cross-file Context
Yangruibo Ding, Zijian Wang, Wasi Uddin Ahmad +5
While pre-trained language models (LM) for code have achieved great success in code completion, they generate code conditioned only on the contents within the file, i.e., in-file c…
Multi-lingual Evaluation of Code Generation Models
Ben Athiwaratkun, Sanjay Krishna Gouda, Zijian Wang +22
We present new benchmarks on evaluation code generation models: MBXP and Multilingual HumanEval, and MathQA-X. These datasets cover over 10 programming languages and are generated…
A Study of Real-World Data Races in Golang
Milind Chabbi, Murali Krishna Ramanathan
The concurrent programming literature is rich with tools and techniques for data race detection. Less, however, has been known about real-world, industry-scale deployment, experien…