2 papers
cs.LG2026
CodeWalk: Generating Coding Benchmarks by Walking a Problem Graph
Jiaxin Fang, Runyuan He, Arnav Gupta +3
High-quality coding problems are expensive to collect. Benchmarks such as SWE-bench rely on substantial human curation, while synthetic alternatives typically rely on costly model…
cs.AI2026
Playing Psychic: Using Thought Trees to Predict Reasoning Models Accuracy on Coding Tasks
Jiaxin Fang, Runyuan He, Sahil Bhatia +2
Recent advances in large language models (LLMs) have shown that test-time scaling can substantially improve model performance on complex tasks, particularly in the coding domain. U…