Learning Markov models via low-rank optimization

Ziwei Zhu, Xudong Li, Mengdi Wang +1

Modeling unknown systems from data is a precursor of system optimization and sequential decision making. In this paper, we focus on learning a Markov model from a single trajectory…