activity
20212026
most citedProspect-theoretic Q-learning

12 citations · 15 across the 17 of their papers we have counts for

collaborators
Showing 2025Show all

5 papers · 1 filter

cs.GT2025

Choose Your Battles: Distributed Learning Over Multiple Tug of War Games

Siddharth Chandak, Ilai Bistritz, Nicholas Bambos

Consider players and games taking place simultaneously. Each of these games is modeled as a Tug-of-War (ToW) game where increasing the action of one player decreases the re…

cs.LG2025

Finite-Time Bound for Non-Linear Two-Time-Scale Stochastic Approximation

Siddharth Chandak

Two-time-scale stochastic approximation (SA) is an algorithm with coupled iterations which has found broad applications in reinforcement learning, optimization and game control. In…

eess.SY2025

Optimal Control for Remote Patient Monitoring with Multidimensional Health States

Siddharth Chandak, Isha Thapa, Nicholas Bambos +1

Selecting the right monitoring level in Remote Patient Monitoring (RPM) systems for e-healthcare is crucial for balancing patient outcomes, various resources, and patient's quality…

cs.LG2025

Finite-Time Bounds for Two-Time-Scale Stochastic Approximation with Arbitrary Norm Contractions and Markovian Noise

Siddharth Chandak, Shaan Ul Haque, Nicholas Bambos

Two-time-scale Stochastic Approximation (SA) is an iterative algorithm with applications in reinforcement learning and optimization. Prior finite time analysis of such algorithms h…

math.OC2025

Non-Expansive Mappings in Two-Time-Scale Stochastic Approximation: Finite-Time Analysis

Siddharth Chandak

Two-time-scale stochastic approximation algorithms are iterative methods used in applications such as optimization, reinforcement learning, and control. Finite-time analysis of the…