3 papers
stat.OT2026
The Fidelity and Feedback Traps: The Case for Health Digital Twins as Modular Evolving Causal Systems
Nikki L. B. Freeman, Yating Zou, Kyungbok Lee +3
Digital twins for health may be used to compare treatments, project patient trajectories, and support clinical decisions. While related to mechanical digital twins, those initially…
stat.ML2026
Provable Offline Reinforcement Learning for Structured Cyclic MDPs
Kyungbok Lee, Angelica Cristello Sarteau, Michael R. Kosorok
We introduce a novel cyclic Markov decision process (MDP) framework for multi-step decision problems with heterogeneous stage-specific dynamics, transitions, and discount factors a…
stat.ML2024
Doubly-Robust Off-Policy Evaluation with Estimated Logging Policy
Kyungbok Lee, Myunghee Cho Paik
We introduce a novel doubly-robust (DR) off-policy evaluation (OPE) estimator for Markov decision processes, DRUnknown, designed for situations where both the logging policy and th…