Showing stat.MLShow all
2 papers · 1 filter
stat.ML2026
Model-based Bootstrap of Controlled Markov Chains
Ziwei Su, Imon Banerjee, Diego Klabjan
We propose and analyze a model-based bootstrap for transition kernels in finite controlled Markov chains (CMCs) with possibly nonstationary or history-dependent control policies, a…
stat.ML2026
Offline Estimation of Controlled Markov Chains: Minimaxity and Sample Complexity
Imon Banerjee, Harsha Honnappa, Vinayak Rao
In this work, we study a natural nonparametric estimator of the transition probability matrices of a finite controlled Markov chain. We consider an offline setting with a fixed dat…