Adaptive Estimation of the Transition Density of Controlled Markov Chains

Imon Banerjee, Vinayak Rao, Harsha Honnappa

Estimating the transition dynamics of controlled Markov chains is crucial in fields such as time series analysis, reinforcement learning, and system exploration. Traditional non-pa…