Showing cs.AIShow all
2 papers · 1 filter
cs.AI2026
Between Spoilers and Guesswork: Avoiding Over-Specification in Coding Benchmarks
Yuanzhe Liu, Bastian Lipka, Avraham Shinnar +3
Benchmarks drive AI progress, but are hampered by task under-specification and over-specification. Task under-specification causes guesswork, where solutions have to make things up…
cs.AI2026
Policy-as-logic for robust reasoning over rules
Rahul Nair, Bastian Lipka, Elizabeth Daly
In many practical applications of generative AI systems, from tax rules to airline baggage allowance, responses to natural language queries must respect written policies or rules.…