5 citations · 10 across the 7 of their papers we have counts for
4 papers · 1 filter
Unsupervised Evaluation of Code LLMs with Round-Trip Correctness
Miltiadis Allamanis, Sheena Panthaplackel, Pengcheng Yin
To evaluate code large language models (LLMs), research has relied on a few small manually curated benchmarks, such as HumanEval and MBPP, which represent a narrow part of the real…
Using Developer Discussions to Guide Fixing Bugs in Software
Sheena Panthaplackel, Milos Gligoric, Junyi Jessy Li +1
Automatically fixing software bugs is a challenging task. While recent work showed that natural language context is useful in guiding bug-fixing models, the approach required promp…
CoditT5: Pretraining for Source Code and Natural Language Editing
Jiyang Zhang, Sheena Panthaplackel, Pengyu Nie +2
Pretrained language models have been shown to be effective in many software-related generation tasks; however, they are not well-suited for editing tasks as they are not designed t…
Deep Just-In-Time Inconsistency Detection Between Comments and Source Code
Sheena Panthaplackel, Junyi Jessy Li, Milos Gligoric +1
Natural language comments convey key aspects of source code such as implementation, usage, and pre- and post-conditions. Failure to update comments accordingly when the correspondi…