4 papers
Beyond Isolated Tasks: A Framework for Evaluating Coding Agents on Sequential Software Evolution
KN Ajay Shastry, Ganesh Senrayan, Shrey Satapara +2
Existing datasets for coding agents evaluate performance on isolated, single pull request (PR) tasks in a stateless manner, failing to capture the reality of real-world software de…
Adaptive LLM Routing under Budget Constraints
Pranoy Panda, Raghav Magazine, Chaitanya Devaguptapu +2
Large Language Models (LLMs) have revolutionized natural language processing, but their varying capabilities and costs pose challenges in practical applications. LLM routing addres…
Interpretable Model Drift Detection
Pranoy Panda, Kancheti Sai Srinivas, Vineeth N Balasubramanian +1
Data in the real world often has an evolving distribution. Thus, machine learning models trained on such data get outdated over time. This phenomenon is called model drift. Knowled…
FW-Shapley: Real-time Estimation of Weighted Shapley Values
Pranoy Panda, Siddharth Tandon, Vineeth N Balasubramanian
Fair credit assignment is essential in various machine learning (ML) applications, and Shapley values have emerged as a valuable tool for this purpose. However, in critical ML appl…