Monitoring State Transitions in Markovian Systems with Sampling Cost

Kumar Saurav, Ness B. Shroff, Yingbin Liang

We consider a node-monitor pair, where the node's state varies with time. The monitor needs to track the node's state at all times; however, there is a fixed cost for each state qu…