activity
20092026
most citedCorrelated Multiarmed Bandit Problem: Bayesian Algorithms and Regret Analysis

11 citations · 64 across the 40 of their papers we have counts for

collaborators

49 papers

eess.SY2026

Reward-Rate Congestion Games and Replicator--Dinkelbach Dynamics

Hassan Abdelraouf, Vaibhav Srivastava, Vijay Gupta

Reward rate is a key performance criterion in cyber-physical and robotic systems where time, workload, and coordination costs are limiting resources. We introduce reward-rate conge…

eess.SY2026

Robustness and Centrality in Markov-switching Networks

Sarah H. Cen, Vaibhav Srivastava, Naomi Ehrich Leonard

We investigate how time-varying interactions, modeled via a Markov switching graph (MSG), impact the robustness of noisy multi-agent dynamics in both continuous- and discrete-time…

math.DS2026

Neuromorphic Realization of Best Response in Finite-Action Games

Himani Sinhmar, Vaibhav Srivastava, Naomi Ehrich Leonard

We develop a mechanistic dynamical-systems formulation of best response in finite-action games with relational structure on the action set. The proposed neuromorphic decision dynam…

q-bio.NC2026

A Normative Theory of Decision Making from Multiple Stimuli: The Contextual Diffusion Decision Model

Michael Shvartsman, Vaibhav Srivastava, Narayanan Sundaram +1

The dynamics of simple two-alternative forced-choice (2AFC) decisions are well-modeled by a class of random walk models (e.g. Laming, 1968; Ratcliff, 1978; Usher & McClelland, 2001…

eess.SY2023★ 5 cited

A Multi-Fidelity Bayesian Approach to Safe Controller Design

Ethan Lau, Vaibhav Srivastava, Shaunak D. Bopardikar

Safely controlling unknown dynamical systems is one of the biggest challenges in the field of control. Oftentimes, an approximate model of a system's dynamics exists which provides…

math.OC2022

SIS Epidemic Spreading under Multi-layer Population Dispersal in Patchy Environments

Vishal Abhishek, Vaibhav Srivastava

We study SIS epidemic spreading models under population dispersal on multi-layer networks. We consider a patchy environment in which each patch comprises individuals belonging to d…

eess.SY2022

Coupled Evolutionary Behavioral and Disease Dynamics under Reinfection Risk

Abhisek Satapathi, Narendra Kumar Dhar, Ashish R. Hota +1

We study the interplay between epidemic dynamics and human decision making for epidemics that involve reinfection risk; in particular, the susceptible-infected-susceptible (SIS) an…

cs.LG2022

Deterministic Sequencing of Exploration and Exploitation for Reinforcement Learning

Piyush Gupta, Vaibhav Srivastava

We propose Deterministic Sequencing of Exploration and Exploitation (DSEE) algorithm with interleaving exploration and exploitation epochs for model-based RL problems that aim to s…

eess.SY2022★ 1 cited

Towards Modeling Human Motor Learning Dynamics in High-Dimensional Spaces

Ankur Kamboj, Rajiv Ranganathan, Xiaobo Tan +1

Designing effective rehabilitation strategies for upper extremities, particularly hands and fingers, warrants the need for a computational model of human motor learning. The presen…

eess.SY2022

Epidemic Propagation under Evolutionary Behavioral Dynamics: Stability and Bifurcation Analysis

Abhisek Satapathi, Narendra Kumar Dhar, Ashish R. Hota +1

We consider the class of SIS epidemic models in which a large population of individuals chooses whether to adopt protection or to remain unprotected as the epidemic evolves. For a…

cs.HC2022★ 2 cited

Structural Properties of Optimal Fidelity Selection Policies for Human-in-the-loop Queues

Piyush Gupta, Vaibhav Srivastava

We study optimal fidelity selection for a human operator servicing a queue of homogeneous tasks. The agent can service a task with a normal or high fidelity level, where fidelity r…

math-ph2021

Narrow Escape Brownian Dynamics Modeling in the Three-Dimensional Unit Sphere

Vaibhava Srivastava, Alexei Cheviakov

The narrow escape problem is a first-passage problem concerned with randomly moving particles in a physical domain, being trapped by absorbing surface traps (windows), such that th…

cs.RO2021

Online Estimation and Coverage Control with Heterogeneous Sensing Information

Andrew McDonald, Lai Wei, Vaibhav Srivastava

Heterogeneous multi-robot sensing systems are able to characterize physical processes more comprehensively than homogeneous systems. Access to multiple modalities of sensory data a…

eess.SY2021

Cloud-Assisted Nonlinear Model Predictive Control for Finite-Duration Tasks

Nan Li, Kaixiang Zhang, Zhaojian Li +2

Cloud computing creates new possibilities for control applications by offering powerful computation and storage capabilities. In this paper, we propose a novel cloud-assisted model…

eess.SY2021

In-flight actuator failure recovery of a hexrotor via multiple models and extended high-gain observers

Connor J. Boss, Vaibhav Srivastava

We study an in-flight actuator failure recovery problem for a hexrotor UAV. The hexrotor may experience external disturbances and modeling error, which are accounted for in the con…

math.DS2021★ 1 cited

Phase Reduction and Synchronization of Coupled Noisy Oscillators

Zahra Aminzare, Vaibhav Srivastava

We study the synchronization behavior of a noisy network in which each system is driven by two sources of state-dependent noise: (1) an intrinsic noise which is common among all sy…

eess.SY2021★ 1 cited

A High-Gain Observer Approach to Robust Trajectory Estimation and Tracking for a Multi-rotor UAV

Connor J Boss, Vaibhav Srivastava

Using the context of trajectory estimation and tracking for multi-rotor unmanned aerial vehicles (UAVs), we explore the challenges in applying high-gain observers to highly dynamic…

cs.LG2021★ 5 cited

Nonstationary Stochastic Multiarmed Bandits: UCB Policies and Minimax Regret

Lai Wei, Vaibhav Srivastava

We study the nonstationary stochastic Multi-Armed Bandit (MAB) problem in which the distribution of rewards associated with each arm are assumed to be time-varying and the total va…

cs.RO2021★ 1 cited

Multi-Robot Gaussian Process Estimation and Coverage: A Deterministic Sequencing Algorithm and Regret Analysis

Lai Wei, Andrew McDonald, Vaibhav Srivastava

We study the problem of distributed multi-robot coverage over an unknown, nonuniform sensory field. Modeling the sensory field as a realization of a Gaussian Process and using Baye…

math.OC2020

Influence Spread in the Heterogeneous Multiplex Linear Threshold Model

Yaofeng Desmond Zhong, Vaibhav Srivastava, Naomi Ehrich Leonard

The linear threshold model (LTM) has been used to study spread on single-layer networks defined by one inter-agent sensing modality and agents homogeneous in protocol. We define an…

stat.ML2020

Minimax Policy for Heavy-tailed Bandits

Lai Wei, Vaibhav Srivastava

We study the stochastic Multi-Armed Bandit (MAB) problem under worst-case regret and heavy-tailed reward distribution. We modify the minimax policy MOSS for the sub-Gaussian reward…

cs.RO2020★ 1 cited

Expedited Multi-Target Search with Guaranteed Performance via Multi-fidelity Gaussian Processes

Lai Wei, Xiaobo Tan, Vaibhav Srivastava

We consider a scenario in which an autonomous vehicle equipped with a downward facing camera operates in a 3D environment and is tasked with searching for an unknown number of stat…

eess.SY2020★ 1 cited

Robust tracking of an unknown trajectory with a multi-rotor UAV: A high-gain observer approach

C. J. Boss, V. Srivastava, H. K. Khalil

We study a trajectory tracking problem for a multi-rotor in the presence of modeling error and external disturbances. The desired trajectory is unknown and generated from a referen…

eess.SY2020

SIS Epidemic Model under Mobility on Multi-layer Networks

Vishal Abhishek, Vaibhav Srivastava

We study the influence of heterogeneous mobility patterns in a population on the SIS epidemic model. In particular, we consider a patchy environment in which each patch comprises i…