6 citations · 6 across the 1 of their papers we have counts for
4 papers · 1 filter
Causal Markov Decision Processes: Learning Good Interventions Efficiently
Yangyi Lu, Amirhossein Meisami, Ambuj Tewari
We introduce causal Markov Decision Processes (C-MDPs), a new formalism for sequential decision making which combines the standard MDP formulation with causal structures over state…
Decision Making Problems with Funnel Structure: A Multi-Task Learning Approach with Application to Email Marketing Campaigns
Ziping Xu, Amirhossein Meisami, Ambuj Tewari
This paper studies the decision making problem with Funnel Structure. Funnel structure, a well-known concept in the marketing field, occurs in those systems where the decision make…
Low-Rank Generalized Linear Bandit Problems
Yangyi Lu, Amirhossein Meisami, Ambuj Tewari
In a low-rank linear bandit problem, the reward of an action (represented by a matrix of size ) is the inner product between the action and an unknown low-rank matr…
Regret Analysis of Bandit Problems with Causal Background Knowledge
Yangyi Lu, Amirhossein Meisami, Ambuj Tewari +1
We study how to learn optimal interventions sequentially given causal information represented as a causal graph along with associated conditional distributions. Causal modeling is…