Showing cs.SEShow all
2 papers · 1 filter
cs.SE2026
SpreadsheetBench 2: Evaluating Agents on End-to-End Business Spreadsheet Workflows
Jian Zhu, Yuzheng Zhang, Zeyao Ma +11
Spreadsheets are widely used for business analysis, financial modeling, reporting, and decision-making. However, most existing spreadsheet benchmarks evaluate isolated operations s…
cs.SE2026
IDE-Bench: Evaluating Large Language Models as IDE Agents on Real-World Software Engineering Tasks
Spencer Mateega, Jeff Yang, Tiana Costello +3
IDE-Bench is a comprehensive framework for evaluating AI IDE agents on real-world software engineering tasks through an IDE-native tool interface. We present a Dockerized test harn…