4 papers
Memory in the Loop: In-Process Retrieval as Extended Working Memory for Language Agents
Yusuf Khan, Carlo Lipizzi
Language agents run a loop - observe, reason, act - but the memory they reason over sits outside it: a store queried at most once per turn. We study the regime where memory moves i…
s2n-bignum-bench: A practical benchmark for evaluating low-level code reasoning of LLMs
Balaji Rao, John Harrison, Soonho Kong +2
Neurosymbolic approaches leveraging Large Language Models (LLMs) with formal methods have recently achieved strong results on mathematics-oriented theorem-proving benchmarks. Howev…
Steve: LLM Powered ChatBot for Career Progression
Naveen Mathews Renji, Balaji Rao, Carlo Lipizzi
The advancements in systems deploying large language models (LLMs), as well as improvements in their ability to act as agents with predefined templates, provide an opportunity to c…
Neural Theorem Proving: Generating and Structuring Proofs for Formal Verification
Balaji Rao, William Eiers, Carlo Lipizzi
Formally verifying properties of software code has been a highly desirable task, especially with the emergence of LLM-generated code. In the same vein, they provide an interesting…