activity
20132023
most citedOn the Optimal Solutions of the Infinite-Horizon Linear Sensor Scheduling Problem

59 citations · 85 across the 15 of their papers we have counts for

collaborators
Showing math.OCShow all

12 papers · 1 filter

math.OC2023

A Bandit Learning Method for Continuous Games under Feedback Delays with Residual Pseudo-Gradient Estimate

Yuanhanqing Huang, Jianghai Hu

Learning in multi-player games can model a large variety of practical scenarios, where each player seeks to optimize its own local objective function, which at the same time relies…

math.OC2023

Bandit Online Learning in Merely Coherent Games with Multi-Point Pseudo-Gradient Estimate

Yuanhanqing Huang, Jianghai Hu

Non-cooperative games serve as a powerful framework for capturing the interactions among self-interested players and have broad applicability in modeling a wide range of practical…

math.OC2023★ 2 cited

Zeroth-Order Learning in Continuous Games via Residual Pseudogradient Estimates

Yuanhanqing Huang, Jianghai Hu

A variety of practical problems can be modeled by the decision-making process in multi-player games where a group of self-interested players aim at optimizing their own local objec…

math.OC2022★ 1 cited

On the Convergence Rates of A Nash Equilibrium Seeking Algorithm in Potential Games with Information Delays

Yuanhanqing Huang, Jianghai Hu

This paper investigates the equilibrium convergence properties of a proposed algorithm for potential games with continuous strategy spaces in the presence of feedback delays, a mai…

math.OC2022

Distributed Stochastic Nash Equilibrium Learning in Locally Coupled Network Games with Unknown Parameters

Yuanhanqing Huang, Jianghai Hu

In stochastic Nash equilibrium problems (SNEPs), it is natural for players to be uncertain about their complex environments and have multi-dimensional unknown parameters in their m…

math.OC2021★ 1 cited

A Distributed GNE Seeking Algorithm Using the Douglas-Rachford Splitting Method

Yuanhanqing Huang, Jianghai Hu

We consider a generalized Nash equilibrium problem (GNEP) for a network of players. Each player tries to minimize a local objective function subject to some resource constraints wh…

math.OC2021★ 14 cited

A Discrete-Time Switching System Analysis of Q-learning

Donghwan Lee, Jianghai Hu, Niao He

This paper develops a novel control-theoretic framework to analyze the non-asymptotic convergence of Q-learning. We show that the dynamics of asynchronous Q-learning with a constan…

math.OC2020★ 1 cited

Column Partition based Distributed Algorithms for Coupled Convex Sparse Optimization: Dual and Exact Regularization Approaches

Jinglai Shen, Jianghai Hu, Eswar Kumar Hathibelagal Kammara

This paper develops column partition based distributed schemes for a class of large-scale convex sparse optimization problems, e.g., basis pursuit (BP), LASSO, basis pursuit denosi…

math.OC2018

Supplemental Material For "Primal-Dual Q-Learning Framework for LQR Design"

Donghwan Lee, Jianghai Hu

Recently, reinforcement learning (RL) is receiving more and more attentions due to its successful demonstrations outperforming human performance in certain challenging tasks. In ou…

math.OC2018★ 7 cited

Primal-Dual Distributed Temporal Difference Learning

Donghwan Lee, Jianghai Hu

The goal of this paper is to study a distributed version of the gradient temporal-difference (GTD) learning algorithm for a class of multi-agent Markov decision processes (MDPs). T…

math.OC2018

Dynamic Programming for POMDP with Jointly Discrete and Continuous State-Spaces

Donghwan Lee, Niao He, Jianghai Hu

In this work, we study dynamic programming (DP) algorithms for partially observable Markov decision processes with jointly continuous and discrete state-spaces. We consider a class…

math.OC2013★ 59 cited

On the Optimal Solutions of the Infinite-Horizon Linear Sensor Scheduling Problem

Lin Zhao, Wei Zhang, Jianghai Hu +2

This paper studies the infinite-horizon sensor scheduling problem for linear Gaussian processes with linear measurement functions. Several important properties of the optimal infin…