2 papers
math.PR2025
Graph-Based Product Form
Céline Comte, Isaac Grosof
Product-form stationary distributions in Markov chains have been a foundational advance and driving force in our understanding of stochastic systems. In this paper, we introduce a…
cs.LG2025
Convergence of Natural Policy Gradient for a Family of Infinite-State Queueing MDPs
Isaac Grosof, Siva Theja Maguluri, R. Srikant
A wide variety of queueing systems can be naturally modeled as infinite-state Markov Decision Processes (MDPs). In the reinforcement learning (RL) context, a variety of algorithms…