17 citations · 69 across the 14 of their papers we have counts for
14 papers
Zero-Waiting Load Balancing with Heterogeneous Servers in Heavy Traffic
Xin Liu, Lei Ying
We study the steady-state delay performance of load balancing in large-scale systems with heterogeneous servers in the heavy-traffic regimes. The system consists of servers, ea…
Adversarially Trained Weighted Actor-Critic for Safe Offline Reinforcement Learning
Honghao Wei, Xiyue Peng, Arnob Ghosh +1
We propose WSAC (Weighted Safe Actor-Critic), a novel algorithm for Safe Offline Reinforcement Learning (RL) under functional approximation, which can robustly optimize policies to…
Safe Reinforcement Learning with Instantaneous Constraints: The Role of Aggressive Exploration
Honghao Wei, Xin Liu, Lei Ying
This paper studies safe Reinforcement Learning (safe RL) with linear function approximation and under hard instantaneous constraints where unsafe actions must be avoided at each st…
Sample Efficient Reinforcement Learning in Mixed Systems through Augmented Samples and Its Applications to Queueing Networks
Honghao Wei, Xin Liu, Weina Wang +1
This paper considers a class of reinforcement learning problems, which involve systems with two types of states: stochastic and pseudo-stochastic. In such systems, stochastic state…
Online Nonstochastic Control with Adversarial and Static Constraints
Xin Liu, Zixian Yang, Lei Ying
This paper studies online nonstochastic control problems with adversarial and static constraints. We propose online nonstochastic control algorithms that achieve both sublinear reg…
Scalable and Sample Efficient Distributed Policy Gradient Algorithms in Multi-Agent Networked Systems
Xin Liu, Honghao Wei, Lei Ying
This paper studies a class of multi-agent reinforcement learning (MARL) problems where the reward that an agent receives depends on the states of other agents, but the next state o…
Large-System Insensitivity of Zero-Waiting Load Balancing Algorithms
Xin Liu, Kang Gong, Lei Ying
This paper studies the sensitivity (or insensitivity) of a class of load balancing algorithms that achieve asymptotic zero-waiting in the sub-Halfin-Whitt regime, named LB-zero. Mo…
A Provably-Efficient Model-Free Algorithm for Constrained Markov Decision Processes
Honghao Wei, Xin Liu, Lei Ying
This paper presents the first model-free, simulator-free reinforcement learning algorithm for Constrained Markov Decision Processes (CMDPs) with sublinear regret and zero constrain…
An Efficient Pessimistic-Optimistic Algorithm for Stochastic Linear Bandits with General Constraints
Xin Liu, Bin Li, Pengyi Shi +1
This paper considers stochastic linear bandits with general nonlinear constraints. The objective is to maximize the expected cumulative reward over horizon subject to a set of…
Beyond Scaling: Calculable Error Bounds of the Power-of-Two-Choices Mean-Field Model in Heavy-Traffic
Fnu Hairi, Xin Liu, Lei Ying
This paper provides a recipe for deriving calculable approximation errors of mean-field models in heavy-traffic with the focus on the well-known load balancing algorithm---power-of…
Steady-State Analysis of Load Balancing with Coxian- Distributed Service Times
Xin Liu, Kang Gong, Lei Ying
This paper studies load balancing for many-server ( servers) systems. Each server has a buffer of size and can have at most one job in service and jobs in the buffe…
On Universal Scaling of Distributed Queues under Load Balancing
Xin Liu, Lei Ying
This paper considers the steady-state performance of load balancing algorithms in a many-server system with distributed queues. The system has servers, and each server maintain…
A Simple Steady-State Analysis of Load Balancing Algorithms in the Sub-Halfin-Whitt Regime
Xin Liu, Lei Ying
This paper studies a class of load balancing algorithms for many-server ( servers) systems assuming finite buffer with size (i.e. a server can have at most one job in serv…
Empty-car routing in ridesharing systems
Anton Braverman, J. G. Dai, Xin Liu +1
This paper considers a closed queueing network model of ridesharing systems such as Didi Chuxing, Lyft, and Uber. We focus on empty-car routing, a mechanism by which we control car…