activity
20172025
most citedAn Actor-Critic Contextual Bandit Algorithm for Personalized Mobile Health Interventions

45 citations · 74 across the 8 of their papers we have counts for

collaborators

8 papers

physics.chem-ph2025

Multistate Density Functional Theory for Local and Charge-Transfer Tripdoublet States from Triplet-Free Radical Interactions

Chenyu Liu, Yang Xu, Peng Bao +2

The interaction between excited states of a closed-shell chromophore and a nearby free radical species gives rise to spin-coupled doublet states, namely singdoublet and tripdoublet…

stat.ML2022★ 1 cited

Offline Policy Evaluation and Optimization under Confounding

Chinmaya Kausik, Yangyi Lu, Kevin Tan +3

Evaluating and optimizing policies in the presence of unobserved confounders is a problem of growing interest in offline reinforcement learning. Using conventional methods for offl…

stat.ML2021★ 6 cited

Bandit Algorithms for Precision Medicine

Yangyi Lu, Ziping Xu, Ambuj Tewari

The Oxford English Dictionary defines precision medicine as "medical care designed to optimize efficiency or therapeutic benefit for particular groups of patients, especially by us…

stat.ML2021★ 6 cited

Causal Bandits with Unknown Graph Structure

Yangyi Lu, Amirhossein Meisami, Ambuj Tewari

In causal bandit problems, the action set consists of interventions on variables of a causal graph. Several researchers have recently studied such bandit problems and pointed out t…

stat.ML2021★ 6 cited

Causal Markov Decision Processes: Learning Good Interventions Efficiently

Yangyi Lu, Amirhossein Meisami, Ambuj Tewari

We introduce causal Markov Decision Processes (C-MDPs), a new formalism for sequential decision making which combines the standard MDP formulation with causal structures over state…

stat.ML2020★ 4 cited

Low-Rank Generalized Linear Bandit Problems

Yangyi Lu, Amirhossein Meisami, Ambuj Tewari

In a low-rank linear bandit problem, the reward of an action (represented by a matrix of size ) is the inner product between the action and an unknown low-rank matr…

stat.ML2019★ 6 cited

Regret Analysis of Bandit Problems with Causal Background Knowledge

Yangyi Lu, Amirhossein Meisami, Ambuj Tewari +1

We study how to learn optimal interventions sequentially given causal information represented as a causal graph along with associated conditional distributions. Causal modeling is…

stat.ML2017★ 45 cited

An Actor-Critic Contextual Bandit Algorithm for Personalized Mobile Health Interventions

Huitian Lei, Yangyi Lu, Ambuj Tewari +1

Increasing technological sophistication and widespread use of smartphones and wearable devices provide opportunities for innovative and highly personalized health interventions. A…