4 papers · 1 filter
Metric-Gradient Projection for Stable Multi-Agent Policy Learning
Zuyuan Zhang, Sizhe Tang, Mahdi Imani +1
General-sum multi-agent learning is often governed by a stacked update field in which each agent's policy update changes the optimization landscape faced by the others. This coupli…
NonZero: Interaction-Guided Exploration for Multi-Agent Monte Carlo Tree Search
Sizhe Tang, Zuyuan Zhang, Mahdi Imani +1
Monte Carlo Tree Search (MCTS) scales poorly in cooperative multi-agent domains because expansion must consider an exponentially large set of joint actions, severely limiting explo…
Cochain Perspectives on Temporal-Difference Signals for Learning Beyond Markov Dynamics
Zuyuan Zhang, Sizhe Tang, Tian Lan
Non-Markovian dynamics are commonly found in real-world environments due to long-range dependencies, partial observability, and memory effects. The Bellman equation that is the cen…
ACDZero: MCTS Agent for Mastering Automated Cyber Defense
Yu Li, Sizhe Tang, Rongqian Chen +5
Automated cyber defense (ACD) seeks to protect computer networks with minimal or no human intervention, reacting to intrusions by taking corrective actions such as isolating hosts,…