most citedDoes the Markov Decision Process Fit the Data: Testing for the Markov Property in Sequential Decision Making

9 citations · 14 across the 5 of their papers we have counts for

collaborators

5 papers

stat.ME20204 cited

Causal Effect Estimation and Optimal Dose Suggestions in Mobile Health

Liangyu Zhu, Wenbin Lu, Rui Song

In this article, we propose novel structural nested models to estimate causal effects of continuous treatments based on mobile health data. To find the treatment regime that optimi…

stat.ME2020

Kernel Assisted Learning for Personalized Dose Finding

Liangyu Zhu, Wenbin Lu, Michael R. Kosorok +1

An individualized dose rule recommends a dose level within a continuous safe dose range based on patient level information such as physical conditions, genetic factors and medicati…

stat.ME2020

A New Framework for Online Testing of Heterogeneous Treatment Effect

Miao Yu, Wenbin Lu, Rui Song

We propose a new framework for online testing of heterogeneous treatment effects. The proposed test, named sequential score test (SST), is able to control type I error under contin…

stat.ML20209 cited

Does the Markov Decision Process Fit the Data: Testing for the Markov Property in Sequential Decision Making

Chengchun Shi, Runzhe Wan, Rui Song +2

The Markov assumption (MA) is fundamental to the empirical validity of reinforcement learning. In this paper, we propose a novel Forward-Backward Learning procedure to test MA in s…

stat.ME20141 cited

Sequential Advantage Selection for Optimal Treatment Regimes

Ailin Fan, Wenbin Lu, Rui Song

Variable selection for optimal treatment regime in a clinical trial or an observational study is getting more attention. Most existing variable selection techniques focused on sele…