12 papers
What Makes Good Agentic Data? An ACE Lens on Data Generation for LLM Agents
Xingshan Zeng, Zishan Xu, Boju Zhang +11
LLM agents increasingly rely on generated interaction data to learn how to interact with external environments. Agentic data generation must maintain consistency among environments…
EnvACE: Internalizing Environment Dynamics via World Rehearsal for Agentic Reinforcement Learning
Zishan Xu, Zhiyuan Yao, Yuxin Chen +9
Training large language model agents for long-horizon tool use typically relies on interactions with real or synthesized executable environments, whose construction and verificatio…
SkillRise: Agentic Reinforcement Learning for Cross-Task Skill Evolution
Zhiyuan Yao, Yuxin Chen, Zhengxi Lu +13
Large language model agents often encounter related yet distinct tasks that share reusable solution patterns. Yet standard agentic reinforcement learning treats tasks as independen…
From Brewing to Resolution: Tracing the Internal Lifecycle of Code Reasoning in LLMs
Siyue Chen, Yifu Guo, Yuquan Lu +9
Standard accuracy metrics cannot explain why LLMs handle variable tracking but fail on semantically equivalent loops. We study an internal lifecycle of code reasoning in which mode…
Zero-Forgetting CISS via Dual-Phase Cognitive Cascades
Yuquan Lu, Yifu Guo, Zishan Xu +6
Continual semantic segmentation (CSS) is a cornerstone task in computer vision that enables a large number of downstream applications, but faces the catastrophic forgetting challen…
EDIS: Diagnosing LLM Reasoning via Entropy Dynamics
Chenghua Zhu, Siyan Wu, Xiangkang Zeng +6
Entropy-based confidence signals are increasingly leveraged to improve reasoning in large language models (LLMs), yet existing approaches treat confidence as a static quantity -- t…
CoBA-RL: Capability-Oriented Budget Allocation for Reinforcement Learning in LLMs
Zhiyuan Yao, Yi-Kai Zhang, Yuxin Chen +7
Reinforcement Learning with Verifiable Rewards (RLVR) has emerged as a key approach for enhancing LLM reasoning. However, standard frameworks like Group Relative Policy Optimizatio…
RealMem: Benchmarking LLMs in Real-World Memory-Driven Interaction
Haonan Bian, Zhiyuan Yao, Sen Hu +7
As Large Language Models (LLMs) evolve from static dialogue interfaces to autonomous general agents, effective memory is paramount to ensuring long-term consistency. However, exist…
ACE-Router: Generalizing History-Aware Routing from MCP Tools to the Agent Web
Zhiyuan Yao, Zishan Xu, Yifu Guo +6
With the rise of the Agent Web and Model Context Protocol (MCP), the agent ecosystem is evolving into an open collaborative network, exponentially increasing accessible tools. Howe…
Octopus: Agentic Multimodal Reasoning with Six-Capability Orchestration
Yifu Guo, Zishan Xu, Zhiyuan Yao +6
Existing multimodal reasoning models and frameworks suffer from fundamental architectural limitations: most lack the human-like ability to autonomously explore diverse reasoning pa…
VideoSeg-R1:Reasoning Video Object Segmentation via Reinforcement Learning
Zishan Xu, Yifu Guo, Yuquan Lu +2
Traditional video reasoning segmentation methods rely on supervised fine-tuning, which limits generalization to out-of-distribution scenarios and lacks explicit reasoning. To addre…
Decoupling Continual Semantic Segmentation
Yifu Guo, Yuquan Lu, Wentao Zhang +5
Continual Semantic Segmentation (CSS) requires learning new classes without forgetting previously acquired knowledge, addressing the fundamental challenge of catastrophic forgettin…