activity
20212025
most citedQ-Learning Lagrange Policies for Multi-Action Restless Bandits

12 citations · 20 across the 10 of their papers we have counts for

collaborators
Showing cs.LGShow all

7 papers · 1 filter

cs.LG2025

Contrasting Cost-Agnostic and Cost-Sensitive Losses under Limited Model Capacity via -consistency

Jessica Finocchiaro, Sanket Shah, Milind Tambe

There is a prevalent debate in machine learning about whether practitioners should train models to optimize a task-agnostic objective (e.g., cross entropy) or incorporate the downs…

cs.LG2024

Evaluating the Effectiveness of Index-Based Treatment Allocation

Niclas Boehmer, Yash Nair, Sanket Shah +3

When resources are scarce, an allocation policy is needed to decide who receives a resource. This problem occurs, for instance, when allocating scarce medical resources and is ofte…

cs.LG2023★ 1 cited

Leaving the Nest: Going Beyond Local Loss Functions for Predict-Then-Optimize

Sanket Shah, Andrew Perrault, Bryan Wilder +1

Predict-then-Optimize is a framework for using machine learning to perform decision-making under uncertainty. The central research question it asks is, "How can the structure of a…

cs.LG2022★ 3 cited

Decision-Focused Learning without Differentiable Optimization: Learning Locally Optimized Decision Losses

Sanket Shah, Kai Wang, Bryan Wilder +2

Decision-Focused Learning (DFL) is a paradigm for tailoring a predictive model to a downstream optimization task that uses its predictions in order to perform better on that specif…

cs.LG2022★ 3 cited

Scalable Decision-Focused Learning in Restless Multi-Armed Bandits with Application to Maternal and Child Health

Kai Wang, Shresth Verma, Aditya Mate +5

This paper studies restless multi-armed bandit (RMAB) problems with unknown arm transition dynamics but with known correlated arm features. The goal is to learn a model to predict…

cs.LG2021★ 12 cited

Q-Learning Lagrange Policies for Multi-Action Restless Bandits

Jackson A. Killian, Arpita Biswas, Sanket Shah +1

Multi-action restless multi-armed bandits (RMABs) are a powerful framework for constrained resource allocation in which independent processes are managed. However, previous wor…

cs.LG2021★ 1 cited

Learning MDPs from Features: Predict-Then-Optimize for Sequential Decision Problems by Reinforcement Learning

Kai Wang, Sanket Shah, Haipeng Chen +3

In the predict-then-optimize framework, the objective is to train a predictive model, mapping from environment features to parameters of an optimization problem, which maximizes de…