finite-horizon mdp 1inventory control 1monte carlo tree search 1q-function variance 1recursive variance estimator 1
From the 1 of 3 linked papers with an AI index.
3 papers
eess.SY2026
Consistent Variance Estimation for Q-Function Estimators in Finite-Horizon MDP Tree Search
Zhenyu Yue, Jie Xu, Chun-Hung Chen +2
The paper analyzes the variance of Q‑function estimators in finite‑horizon MDP tree search, shows that standard i.i.d. variance estimates are biased, and introduces a consistent re…
eess.SY2026
Sensitivity analysis for stopping criteria with application to organ transplantations
Xingyu Ren, Michael C. Fu, Steven I. Marcus
We consider a stopping problem and its application to the decision-making process regarding the optimal timing of organ transplantation for individual patients. At each decision pe…
stat.ME2026
Graph Generation Methods under Partial Information
Tong Sun, Jianshu Hao, Michael C. Fu +1
We study the problem of generating graphs with prescribed degree sequences for bipartite, directed, and undirected networks. We first propose a sequential method for bipartite grap…