activity
20212025
most citedQ-Learning Lagrange Policies for Multi-Action Restless Bandits

12 citations · 20 across the 10 of their papers we have counts for

collaborators

10 papers

cs.LG2025

Contrasting Cost-Agnostic and Cost-Sensitive Losses under Limited Model Capacity via -consistency

Jessica Finocchiaro, Sanket Shah, Milind Tambe

There is a prevalent debate in machine learning about whether practitioners should train models to optimize a task-agnostic objective (e.g., cross entropy) or incorporate the downs…

cs.MA2025

Finite-Horizon Single-Pull Restless Bandits: An Efficient Index Policy For Scarce Resource Allocation

Guojun Xiong, Haichuan Wang, Yuqi Pan +4

Restless multi-armed bandits (RMABs) have been highly successful in optimizing sequential resource allocation across many domains. However, in many practical settings with highly s…

cs.AI2024

Efficient Public Health Intervention Planning Using Decomposition-Based Decision-Focused Learning

Sanket Shah, Arun Suggala, Milind Tambe +1

The declining participation of beneficiaries over time is a key concern in public health programs. A popular strategy for improving retention is to have health workers `intervene'…

cs.LG2024

Evaluating the Effectiveness of Index-Based Treatment Allocation

Niclas Boehmer, Yash Nair, Sanket Shah +3

When resources are scarce, an allocation policy is needed to decide who receives a resource. This problem occurs, for instance, when allocating scarce medical resources and is ofte…

cs.LG2023★ 1 cited

Leaving the Nest: Going Beyond Local Loss Functions for Predict-Then-Optimize

Sanket Shah, Andrew Perrault, Bryan Wilder +1

Predict-then-Optimize is a framework for using machine learning to perform decision-making under uncertainty. The central research question it asks is, "How can the structure of a…

cs.LG2022★ 3 cited

Decision-Focused Learning without Differentiable Optimization: Learning Locally Optimized Decision Losses

Sanket Shah, Kai Wang, Bryan Wilder +2

Decision-Focused Learning (DFL) is a paradigm for tailoring a predictive model to a downstream optimization task that uses its predictions in order to perform better on that specif…

cs.LG2022★ 3 cited

Scalable Decision-Focused Learning in Restless Multi-Armed Bandits with Application to Maternal and Child Health

Kai Wang, Shresth Verma, Aditya Mate +5

This paper studies restless multi-armed bandit (RMAB) problems with unknown arm transition dynamics but with known correlated arm features. The goal is to learn a model to predict…

cs.AI2021

Data-Driven Methods for Balancing Fairness and Efficiency in Ride-Pooling

Naveen Raman, Sanket Shah, John Dickerson

Rideshare and ride-pooling platforms use artificial intelligence-based matching algorithms to pair riders and drivers. However, these platforms can induce inequality either through…

cs.LG2021★ 12 cited

Q-Learning Lagrange Policies for Multi-Action Restless Bandits

Jackson A. Killian, Arpita Biswas, Sanket Shah +1

Multi-action restless multi-armed bandits (RMABs) are a powerful framework for constrained resource allocation in which independent processes are managed. However, previous wor…

cs.LG2021★ 1 cited

Learning MDPs from Features: Predict-Then-Optimize for Sequential Decision Problems by Reinforcement Learning

Kai Wang, Sanket Shah, Haipeng Chen +3

In the predict-then-optimize framework, the objective is to train a predictive model, mapping from environment features to parameters of an optimization problem, which maximizes de…