7 papers
Counterfactually Fair Reinforcement Learning via Sequential Data Preprocessing
Jitao Wang, Chengchun Shi, John D. Piette +3
When applied in healthcare, reinforcement learning (RL) seeks to dynamically match the right interventions to subjects to maximize population benefit. However, the learned policy m…
Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning
Shuguang Yu, Shuxing Fang, Ruixin Peng +3
This paper studies off-policy evaluation (OPE) in the presence of unmeasured confounders. Inspired by the two-way fixed effects regression model widely used in the panel data liter…
Pessimistic Causal Reinforcement Learning with Mediators for Confounded Offline Data
Danyang Wang, Chengchun Shi, Shikai Luo +1
In real-world scenarios, datasets collected from randomized experiments are often constrained by size, due to limitations in time and budget. As a result, leveraging large observat…
On Efficient Inference of Causal Effects with Multiple Mediators
Haoyu Wei, Hengrui Cai, Chengchun Shi +1
This paper provides robust estimators and efficient inference of causal effects involving multiple interacting mediators. Most existing works either impose a linear model assumptio…
Optimal Treatment Allocation for Efficient Policy Evaluation in Sequential Decision Making
Ting Li, Chengchun Shi, Jianing Wang +2
A/B testing is critical for modern technological companies to evaluate the effectiveness of newly developed products against standard baselines. This paper studies optimal designs…
Testing for the Markov Property in Time Series via Deep Conditional Generative Learning
Yunzhe Zhou, Chengchun Shi, Lexin Li +1
The Markov property is widely imposed in analysis of time series data. Correspondingly, testing the Markov property, and relatedly, inferring the order of a Markov model, are of pa…