2 citations · 8 across the 12 of their papers we have counts for
5 papers · 1 filter
Beyond Type-checking: Towards Holistic Evaluation of Formal Specification Generation
Srijith Nair, Aditya Vempaty, Jia Liu +1
When generating verifiable code, natural language requirements are mapped to machine checked code using LLMs and agentic workflows. A crucial component of this pipeline is specific…
Eliciting Specifications: When Does Interactive Clarification Help?
Mowafak Allaham, Aditya Vempaty, Ashish Jagmohan +2
LLMs can generate Lean specifications from task descriptions, but those descriptions are often underspecified or ambiguous and may omit verifier-relevant edge cases, yielding imper…
Second-Order Problem Solving for Recursive Self-Improvement in Formal Verification
Yuxuan Jiang, Aditya Vempaty, Ashish Jagmohan
Recursive self-improvement (RSI) enables agents to iteratively optimize their workflows via execution feedback. However, standard RSI typically operates as a first-order optimizer:…
Emergence World: Adversarial Stress-Testing of Long-Horizon Multi-Agent Systems
Deepak Akkil, Tamer Abuelsaad, Karthik Vikram +5
As AI agents move from bounded tasks to persistent deployments, failures can propagate through memory, tools, other agents, and environmental state long after their interactions. T…
Emergence World: A Platform for Evaluating Long-Horizon Multi-Agent Autonomy
Deepak Akkil, Ravi Kokku, Karthik Vikram +3
Most evaluations of LLM agents look like exams: a discrete task, a clean environment, a score in minutes or hours. We argue that this approach is mismatched with the deployment con…