3 papers
cs.AI2026
Between Spoilers and Guesswork: Avoiding Over-Specification in Coding Benchmarks
Yuanzhe Liu, Bastian Lipka, Avraham Shinnar +3
Benchmarks drive AI progress, but are hampered by task under-specification and over-specification. Task under-specification causes guesswork, where solutions have to make things up…
cs.AI2026
Policy-as-logic for robust reasoning over rules
Rahul Nair, Bastian Lipka, Elizabeth Daly
In many practical applications of generative AI systems, from tax rules to airline baggage allowance, responses to natural language queries must respect written policies or rules.…
cs.SE2026
PerfAgent: Profiler-Guided Iterative Refinement for Repository-Level Code Optimization
Ryan Deng, Yuanzhe Liu, Bastian Lipka +4
Large language model (LLM) agents now perform well on correctness-oriented repository-level tasks, including SWE-Bench issue resolution and feature implementation in real codebases…