activity
20152024
most citedAn Efficient Pessimistic-Optimistic Algorithm for Stochastic Linear Bandits with General Constraints

17 citations · 29 across the 9 of their papers we have counts for

collaborators

9 papers

math.OC2024

Inpatient Overflow Management with Proximal Policy Optimization

Jingjing Sun, Jim Dai, Pengyi Shi

Problem Definition: Managing inpatient flow in large hospital systems is challenging due to the complexity of assigning randomly arriving patients -- either waiting for primary uni…

cs.LG2022★ 3 cited

Data-pooling Reinforcement Learning for Personalized Healthcare Intervention

Xinyun Chen, Pengyi Shi, Shanwen Pu

Motivated by the emerging needs of personalized preventative intervention in many healthcare applications, we consider a multi-stage, dynamic decision-making problem in the online…

cs.LG2021★ 2 cited

Group-Aware Threshold Adaptation for Fair Classification

Taeuk Jang, Pengyi Shi, Xiaoqian Wang

The fairness in machine learning is getting increasing attention, as its applications in different fields continue to expand and diversify. To mitigate the discriminated model beha…

cs.LG2021

A High-fidelity, Machine-learning Enhanced Queueing Network Simulation Model for Hospital Ultrasound Operations

Yihan Pan, Zhenghang Xu, Jin Guang +10

We collaborate with a large teaching hospital in Shenzhen, China and build a high-fidelity simulation model for its ultrasound center to predict key performance metrics, including…

cs.LG2021★ 17 cited

An Efficient Pessimistic-Optimistic Algorithm for Stochastic Linear Bandits with General Constraints

Xin Liu, Bin Li, Pengyi Shi +1

This paper considers stochastic linear bandits with general nonlinear constraints. The objective is to maximize the expected cumulative reward over horizon subject to a set of…

cs.LG2020★ 5 cited

POND: Pessimistic-Optimistic oNline Dispatching

Xin Liu, Bin Li, Pengyi Shi +1

This paper considers constrained online dispatching with unknown arrival, reward and constraint distributions. We propose a novel online dispatching algorithm, named POND, standing…

cs.RO2019★ 2 cited

Robustness-Driven Exploration with Probabilistic Metric Temporal Logic

Xiaotian Liu, Pengyi Shi, Sarra Alqahtani +2

The ability to perform autonomous exploration is essential for unmanned aerial vehicles (UAV) operating in unstructured or unknown environments where it is hard or even impossible…

math.PR2016

Steady-state Diffusion Approximations for Discrete-time Queue in Hospital Inpatient Flow Management

Jiekun Feng, Pengyi Shi

In this paper, we analyze a discrete-time queue that is motivated from studying hospital inpatient flow management, where the customer count process captures the midnight inpatient…

math.PR2015

Technical Note for Discrete-Time Diffusion Approximations Motivated from Hospital Inpatient Flow Management

J. G. Dai, Pengyi Shi

This note details the development of a discrete-time diffusion process to approximate the midnight customer count process in a s…