4 papers
Investigating Autonomous Agent Contributions in the Wild: Activity Patterns and Code Change over Time
Razvan Mihai Popescu, David Gros, Andrei Botocan +3
The rise of large language models for code has reshaped software development. Autonomous coding agents, able to create branches, open pull requests, and perform code reviews, now a…
Calibration of Large Language Models on Code Summarization
Yuvraj Virk, Premkumar Devanbu, Toufique Ahmed
A brief, fluent, and relevant summary can be helpful during program comprehension; however, such a summary does require significant human effort to produce. Often, good summaries a…
CoDocBench: A Dataset for Code-Documentation Alignment in Software Maintenance
Kunal Pai, Premkumar Devanbu, Toufique Ahmed
One of the central tasks in software maintenance is being able to understand and develop code changes. Thus, given a natural language description of the desired new operation of a…
Can LLMs Replace Manual Annotation of Software Engineering Artifacts?
Toufique Ahmed, Premkumar Devanbu, Christoph Treude +1
Experimental evaluations of software engineering innovations, e.g., tools and processes, often include human-subject studies as a component of a multi-pronged strategy to obtain gr…