4 papers
Code Researcher: Deep Research Agent for Large Systems Code and Commit History
Ramneet Singh, Sathvik Joel, Abhav Mehrotra +4
Large Language Model (LLM)-based coding agents have shown promising results on coding benchmarks, but their effectiveness on systems code remains underexplored. Due to the size and…
interwhen: A Generalizable Framework for Steering Reasoning Models with Test-time Verification
Vishak K Bhat, Prateek Chanda, Vijval Ekbote +6
Reasoning models produce long traces of intermediate decisions and tool calls, making test-time verification important for ensuring correctness. Existing approaches either verify o…
Robust Learning of Diverse Code Edits
Tushar Aggarwal, Swayam Singh, Abhijeet Awasthi +2
Software engineering activities frequently involve edits to existing code. However, contemporary code language models (LMs) lack the ability to handle diverse types of code-edit re…
NoFunEval: Funny How Code LMs Falter on Requirements Beyond Functional Correctness
Manav Singhal, Tushar Aggarwal, Abhijeet Awasthi +2
Existing evaluation benchmarks of language models of code (code LMs) focus almost exclusively on whether the LMs can generate functionally-correct code. In real-world software engi…