activity
20122020
most citedLearning in Markov Decision Processes under Constraints

18 citations · 35 across the 13 of their papers we have counts for

collaborators

14 papers

eess.SY2020★ 2 cited

Fleet Sizing and Charger Allocation in Electric Vehicle Sharing Systems

Yuntian Deng, Abhishek Gupta, Ness B. Shroff

In this paper, we propose a closed queueing network model for performance analysis of electric vehicle sharing systems with a certain number of chargers in each neighborhood. Depen…

cs.LG2020★ 8 cited

ByGARS: Byzantine SGD with Arbitrary Number of Attackers

Jayanth Regatti, Hao Chen, Abhishek Gupta

We propose two novel stochastic gradient descent algorithms, ByGARS and ByGARS++, for distributed machine learning in the presence of any number of Byzantine adversaries. In these…

q-bio.SC2020

Steady-state fluctuations of a genetic feedback loop with fluctuating rate parameters using the unified colored noise approximation

James Holehouse, Abhishek Gupta, Ramon Grima

A common model of stochastic auto-regulatory gene expression describes promoter switching via cooperative protein binding, effective protein production in the active state and dilu…

cs.LG2020

Convergence of Recursive Stochastic Algorithms using Wasserstein Divergence

Abhishek Gupta, William B. Haskell

This paper develops a unified framework, based on iterated random operator theory, to analyze the convergence of constant stepsize recursive stochastic algorithms (RSAs). RSAs use…

cs.LG2020★ 18 cited

Learning in Markov Decision Processes under Constraints

Rahul Singh, Abhishek Gupta, Ness B. Shroff

We consider reinforcement learning (RL) in Markov Decision Processes in which an agent repeatedly interacts with an environment that is modeled by a controlled Markov process. At e…

stat.ML2019★ 1 cited

Distributed SGD Generalizes Well Under Asynchrony

Jayanth Regatti, Gaurav Tendolkar, Yi Zhou +2

The performance of fully synchronized distributed systems has faced a bottleneck due to the big data trend, under which asynchronous distributed systems are becoming a major popula…

cs.LG2019

Some Limit Properties of Markov Chains Induced by Stochastic Recursive Algorithms

Abhishek Gupta, Hao Chen, Jianzong Pi +1

Recursive stochastic algorithms have gained significant attention in the recent past due to data driven applications. Examples include stochastic gradient descent for solving large…

cs.GT2019

Rank Reduction in Bimatrix Games

Joseph L. Heyman, Abhishek Gupta

The rank of a bimatrix game is defined as the rank of the sum of the payoff matrices of the two players. The rank of a game is known to impact both the most suitable computation me…

cs.GT2019★ 1 cited

Two Algorithms for Computing Exact and Approximate Nash Equilibria in Bimatrix Games

Jianzong Pi, Joseph L. Heyman, Abhishek Gupta

In this paper, we first devise two algorithms to determine whether or not a bimatrix game has a strategically equivalent zero-sum game. If so, we propose an algorithm that computes…

eess.SY2018

Auctioning Electricity under Deep Renewable Integration using a Penalty for Shortfall

Balsam Dakhil, Abhishek Gupta

We analyze the problem of a renewable generator who wants to sell its random generation in a two-stage market to a number of strategic, but flexible, load serving entities (LSEs).…

math.PR2018★ 4 cited

Probabilistic Contraction Analysis of Iterated Random Operators

Abhishek Gupta, Rahul Jain, Peter Glynn

In many branches of engineering, Banach contraction mapping theorem is employed to establish the convergence of certain deterministic algorithms. Randomized versions of these algor…

eess.SY2014★ 1 cited

On the Existence of Optimal Policies for a Class of Static and Sequential Dynamic Teams

Abhishek Gupta, Serdar Yuksel, Tamer Basar +1

In this paper, we identify sufficient conditions under which static teams and a class of sequential dynamic teams admit team-optimal solutions. We first investigate the existence o…

eess.SY2014

Common Information based Markov Perfect Equilibria for Linear-Gaussian Games with Asymmetric Information

Abhishek Gupta, Ashutosh Nayyar, Cedric Langbort +1

We consider a class of two-player dynamic stochastic nonzero-sum games where the state transition and observation equations are linear, and the primitive random variables are Gauss…

cs.GT2012

Nash Equilibria for Stochastic Games with Asymmetric Information-Part 1: Finite Games

Ashutosh Nayyar, Abhishek Gupta, Cédric Langbort +1

A model of stochastic games where multiple controllers jointly control the evolution of the state of a dynamic system but have access to different information about the state and a…