activity
20152026
most citedFinite-Time Analysis of Distributed TD(0) with Linear Function Approximation for Multi-Agent Reinforcement Learning

50 citations · 68 across the 17 of their papers we have counts for

collaborators

23 papers

math.OC2026

Transform Method for Stochastic Processing and Matching Networks

Sushil Mahavir Varma, Prakirt Jhunjhunwala, Daniela Hurtado-Lange +1

Modern service systems, ranging from cloud data centers and ride-hailing platforms to healthcare facilities, operate at massive scales where it is important to handle congestion. Q…

math.PR2026

Tail Bounds for Queues with Abandonment: Constant, Moderate, Large Deviations, and Efficient Concentration

Zedong Wang, Siva Theja Maguluri

We study a heavily overloaded single-server queue with abandonment and derive bounds on stationary tail probabilities of the queue length. As the abandonment rate ,…

math.OC2026

Almost Sure Convergence of Stochastic Approximation: An Interplay of Noise and Step Size

Quang Dinh Thien Nguyen, Duc Anh Nguyen, Hoang Huy Nguyen +1

We study the almost sure convergence of the Stochastic Approximation algorithm to the fixed point of a nonlinear operator under a negative drift condition and a general n…

math.PR2026

Higher-Order Approximations of Sojourn Times in M/G/1 Queues via Stein's Method

Bihan Chatterjee, Siva Theja Maguluri, Debankur Mukherjee

We study the stationary sojourn time distribution in an M/G/1 queue operating under heavy traffic. It is known that the sojourn time converges to an exponential distribution in the…

math.PR2025

Finite-Time Behavior of Erlang-C Model: Mixing Time, Mean Queue Length and Tail Bounds

Hoang Huy Nguyen, Sushil Mahavir Varma, Siva Theja Maguluri

Service systems like data centers and ride-hailing are popularly modeled as queueing systems in the literature. Such systems are primarily studied in the steady state due to their…

cs.LG2025

A Non-Asymptotic Theory of Seminorm Lyapunov Stability: From Deterministic to Stochastic Iterative Algorithms

Zaiwei Chen, Sheng Zhang, Zhe Zhang +2

We study the problem of solving fixed-point equations for seminorm-contractive operators and establish foundational results on the non-asymptotic behavior of iterative algorithms i…