8 papers
UniMem: Complementary Episodic-to-Parametric Memory for Boundary-Agnostic Task Streams
Siyu Xia, Chenheng Zhang, Yanting Wu +8
Memory is essential for LLM agents to accumulate task experience and reuse task-specific execution strategies. However, real-world deployment over boundary-agnostic and evolving ta…
Skill-Pro: Learning Reusable Skills from Experience via Non-Parametric PPO for LLM Agents
Qirui Mi, Zhijian Ma, Mengyue Yang +4
LLM-driven agents excel at sequential decision-making but often rely on on-the-fly reasoning, re-deriving solutions even in recurring scenarios. This insufficient experience reuse…
Learning Stateful Predictive Knowledge From Experience
Yan Song, Xidong Feng, Bo Liu +7
As large language model (LLM) agents increasingly learn from experience, they primarily rely on trajectory-level reflection to extract insights. Viewed through the lens of predicti…
From Experience to Strategy: Empowering LLM Agents with Trainable Graph Memory
Siyu Xia, Zekun Xu, Jiajun Chai +7
Large Language Models (LLMs) based agents have demonstrated remarkable potential in autonomous task-solving across complex, open-ended environments. A promising approach for improv…
Curious Causality-Seeking Agents Learn Meta Causal World
Zhiyu Zhao, Haoxuan Li, Haifeng Zhang +4
When building a world model, a common assumption is that the environment has a single, unchanging underlying causal rule, like applying Newton's laws to every situation. In reality…
Memory-Driven Self-Improvement for Decision Making with Large Language Models
Xue Yan, Zijing Ou, Mengyue Yang +4
Large language models (LLMs) have emerged as effective action policies for sequential decision-making (SDM) tasks due to their extensive prior knowledge. However, this broad yet ge…