6 citations · 18 across the 20 of their papers we have counts for
20 papers
A Communication-Efficient Distributed Optimization Algorithm for Problems with Coupling Constraints
Yuzhu Duan, Ziwen Yang, Xiaoming Duan +1
Resource allocation is a fundamental problem in Industrial Internet of Things (IIoT) systems, in which devices work together under limited communication bandwidth to complete diver…
Multiplayer Homicidal Chauffeur Reach-Avoid Games: A Pursuit Enclosure Function Approach
Rui Yan, Xiaoming Duan, Rui Zou +3
This paper presents a multiplayer Homicidal Chauffeur reach-avoid differential game, which involves Dubins-car pursuers and simple-motion evaders. The goal of the pursuers is to co…
A Stochastic Surveillance Stackelberg Game: Co-Optimizing Defense Placement and Patrol Strategy
Yohan John, Gilberto Diaz-Garcia, Xiaoming Duan +2
Stochastic patrol routing is known to be advantageous in adversarial settings; however, the optimal choice of stochastic routing strategy is dependent on a model of the adversary.…
Control Input Inference of Mobile Agents under Unknown Objective
Chendi Qu, Jianping He, Xiaoming Duan +1
Trajectory and control secrecy is an important issue in robotics security. This paper proposes a novel algorithm for the control input inference of a mobile agent without knowing i…
Reinforcement Learning with Temporal-Logic-Based Causal Diagrams
Yash Paliwal, Rajarshi Roy, Jean-Raphaël Gaglione +5
We study a class of reinforcement learning (RL) tasks where the objective of the agent is to accomplish temporally extended goals. In this setting, a common approach is to represen…
Revisiting Estimation Bias in Policy Gradients for Deep Reinforcement Learning
Haoxuan Pan, Deheng Ye, Xiaoming Duan +4
We revisit the estimation bias in policy gradients for the discounted episodic Markov decision process (MDP) from Deep Reinforcement Learning (DRL) perspective. The objective is fo…
Finite-horizon Equilibria for Neuro-symbolic Concurrent Stochastic Games
Rui Yan, Gabriel Santos, Xiaoming Duan +2
We present novel techniques for neuro-symbolic concurrent stochastic games, a recently proposed modelling formalism to represent a set of probabilistic agents operating in a contin…
Learning-Based Motion Planning with Mixture Density Networks
Yinghan Wang, Xiaoming Duan, Jianping He
The trade-off between computation time and path optimality is a key consideration in motion planning algorithms. While classical sampling based algorithms fall short of computation…
Evaluation and Learning in Two-Player Symmetric Games via Best and Better Responses
Rui Yan, Weixian Zhang, Ruiliang Deng +3
Artificial intelligence and robotic competitions are accompanied by a class of game paradigms in which each player privately commits a strategy to a game system which simulates the…
On the Detection of Markov Decision Processes
Xiaoming Duan, Yagiz Savas, Rui Yan +2
We study the detection problem for a finite set of Markov decision processes (MDPs) where the MDPs have the same state and action spaces but possibly different probabilistic transi…
Privacy-Utility Trade-Offs Against Limited Adversaries
Xiaoming Duan, Zhe Xu, Rui Yan +1
We study privacy-utility trade-offs where users share privacy-correlated useful information with a service provider to obtain some utility. The service provider is adversarial in t…
Robust Pandemic Control Synthesis with Formal Specifications: A Case Study on COVID-19 Pandemic
Zhe Xu, Xiaoming Duan
Pandemics can bring a range of devastating consequences to public health and the world economy. Identifying the most effective control strategies has been the imperative task all a…
Stochastic Strategies for Robotic Surveillance as Stackelberg Games
Xiaoming Duan, Dario Paccagnan, Francesco Bullo
This paper studies a stochastic robotic surveillance problem where a mobile robot moves randomly on a graph to capture a potential intruder that strategically attacks a location on…
Markov Chain-Based Stochastic Strategies for Robotic Surveillance
Xiaoming Duan, Francesco Bullo
This article surveys recent advancements of strategy designs for persistent robotic surveillance tasks with the focus on stochastic approaches. The problem describes how mobile rob…
Policy Evaluation and Seeking for Multi-Agent Reinforcement Learning via Best Response
Rui Yan, Xiaoming Duan, Zongying Shi +3
This paper introduces two metrics (cycle-based and memory-based metrics), grounded on a dynamical game-theoretic solution concept called sink equilibrium, for the evaluation, ranki…
Robotic Surveillance Based on the Meeting Time of Random Walks
Xiaoming Duan, Mishel George, Rushabh Patel +1
This paper analyzes the meeting time between a pair of pursuer and evader performing random walks on digraphs. The existing bounds on the meeting time usually work only for certain…
Matching-Based Capture Strategies for 3D Heterogeneous Multiplayer Reach-Avoid Differential Games
Rui Yan, Xiaoming Duan, Zongying Shi +2
This paper studies a 3D multiplayer reach-avoid differential game with a goal region and a play region. Multiple pursuers defend the goal region by consecutively capturing multiple…
Graph-Theoretic Stability Conditions for Metzler Matrices and Monotone Systems
Xiaoming Duan, Saber Jafarpour, Francesco Bullo
This paper studies the graph-theoretic conditions for stability of positive monotone systems. Using concepts from input-to-state stability and network small-gain theory, we first e…
Markov Chains with Maximum Return Time Entropy for Robotic Surveillance
Xiaoming Duan, Mishel George, Francesco Bullo
Motivated by robotic surveillance applications, this paper studies the novel problem of maximizing the return time entropy of a Markov chain, subject to a graph topology with trave…
Linear Stochastic Approximation Algorithms and Group Consensus over Random Signed Networks: A Technical Report with All Proofs
Ge Chen, Xiaoming Duan, Wenjun Mei +1
This paper studies linear stochastic approximation (SA) algorithms and their application to multi-agent systems in engineering and sociology. As main contribution, we provide neces…