11 citations · 12 across the 4 of their papers we have counts for
5 papers
SlopCodeBench: Benchmarking How Coding Agents Degrade Over Long-Horizon Iterative Tasks
Gabriel Orlanski, Devjeet Roy, Alexander Yun +7
Software development is iterative, yet agentic coding benchmarks hide design issues through their single-shot setup. Recent iterative benchmarks attempt to remedy this but heavily…
Context-Specific Instruction: A Longitudinal Study on Debugging Skill Acquisition and Retention for Novice Programmers
Ziyi Zhang, Devjeet Roy, Venera Arnaoudova
Bug localization is a critical skill, yet novices often lack systematic approaches. Prior work tested abstract guidelines and general concrete steps; the impact of context-specific…
Conformal Prediction Sets for Deep Generative Models via Reduction to Conformal Regression
Hooman Shahrokhi, Devjeet Raj Roy, Yan Yan +2
We consider the problem of generating valid and small prediction sets by sampling outputs (e.g., software code and natural language text) from a black-box deep generative model for…
Exploring LLM-based Agents for Root Cause Analysis
Devjeet Roy, Xuchao Zhang, Rashi Bhave +4
The growing complexity of cloud based software systems has resulted in incident management becoming an integral part of the software development lifecycle. Root cause analysis (RCA…
gazel: Supporting Source Code Edits in Eye-Tracking Studies
Sarah Fakhoury, Devjeet Roy, Harry Pines +5
Eye tracking tools are used in software engineering research to study various software development activities. However, a major limitation of these tools is their inability to trac…