99 citations · 227 across the 34 of their papers we have counts for
9 papers · 1 filter
Agent-state based policies in POMDPs: Beyond belief-state MDPs
Amit Sinha, Aditya Mahajan
The traditional approach to POMDPs is to convert them into fully observed MDPs by considering a belief state as an information state. However, a belief-state based approach require…
Scalable regret for learning to control network-coupled subsystems with unknown dynamics
Sagar Sudhakara, Aditya Mahajan, Ashutosh Nayyar +1
We consider the problem of controlling an unknown linear quadratic Gaussian (LQG) system consisting of multiple subsystems connected over a network. Our goal is to minimize and qua…
Two families of indexable partially observable restless bandits and Whittle index computation
Nima Akbarzadeh, Aditya Mahajan
We consider the restless bandits with general state space under partial observability with two observational models: first, the state of each bandit is not observable at all, and s…
Optimal control of network-coupled subsystems: Spectral decomposition and low-dimensional solutions
Shuang Gao, Aditya Mahajan
In this paper, we investigate optimal control of network-coupled subsystems where the dynamics and the cost couplings depend on an underlying undirected weighted graph. The graph c…
Conditions for indexability of restless bandits and an O(K^3) algorithm to compute Whittle index
Nima Akbarzadeh, Aditya Mahajan
Restless bandits are a class of sequential resource allocation problems concerned with allocating one or more resources among several alternative processes where the evolution of t…
Remote estimation over a packet-drop channel with Markovian state
Jhelum Chakravorty, Aditya Mahajan
We investigate a remote estimation problem in which a transmitter observes a Markov source and chooses the power level to transmit it over a time-varying packet-drop channel. The c…
Linear Quadratic Mean Field Teams: Optimal and Approximately Optimal Decentralized Solutions
Jalal Arabneydi, Aditya Mahajan
We consider team optimal control of decentralized systems with linear dynamics, quadratic costs, and arbitrary disturbance that consist of multiple sub-populations with exchangeabl…
Decentralized Stochastic Control with Partial History Sharing: A Common Information Approach
Ashutosh Nayyar, Aditya Mahajan, Demosthenis Teneketzis
A general model of decentralized stochastic control called partial history sharing information structure is presented. In this model, at each step the controllers share part of the…
Optimal decentralized control of coupled subsystems with control sharing
Aditya Mahajan
Subsystems that are coupled due to dynamics and costs arise naturally in various communication applications. In many such applications the control actions are shared between differ…