From the 1 of 7 linked papers with an AI index.
7 papers
Recovery Control in Replicated Systems through Autonomous Multiagent Rollout
Kim Hammar, Yuchao Li
The paper formulates the timing of replica recovery in redundant computing systems as a multi‑agent POMDP and proposes a multi‑agent rollout approach that uses precomputed signalin…
Compressed Traffic Assignment with the Augmented Lagrangian Method
Xuesong Zhou, Peiheng Li, Yuchao Li +1
We consider large-scale traffic assignment problems and develop a path-based compression framework. In particular, we partition paths into major and minor paths according to a set…
On-Line Policy Iteration with Trajectory-Driven Policy Generation
Yuchao Li, Fei Chen, Yingke Li +2
We consider deterministic finite-horizon optimal control problems with a fixed initial state. We introduce an on-line policy iteration method, which, starting from a given policy,…
An Error Bound for Aggregation in Approximate Dynamic Programming
Yuchao Li, Dimitri Bertsekas
We consider a general aggregation framework for discounted finite-state infinite horizon dynamic programming (DP) problems. It defines an aggregate problem whose optimal cost funct…
Adaptive Network Security Policies via Belief Aggregation and Rollout
Kim Hammar, Yuchao Li, Tansu Alpcan +2
Evolving security vulnerabilities and shifting operational conditions require frequent updates to network security policies. These updates include adjustments to incident response…
Semilinear Dynamic Programming: Analysis, Algorithms, and Certainty Equivalence Properties
Yuchao Li, Dimitri Bertsekas
We consider a broad class of dynamic programming (DP) problems that involve a partially linear structure and some positivity properties in their system equation and cost function.…