2.7k citations · 4k across the 84 of their papers we have counts for
86 papers
Bayesian policy gradient and actor-critic algorithms
Mohammad Ghavamzadeh, Yaakov Engel, Michal Valko
Policy gradient methods are reinforcement learning algorithms that adapt a parameterized policy by following a performance gradient estimate. Conventional policy gradient methods u…
Maximum Entropy Semi-Supervised Inverse Reinforcement Learning
Julien Audiffren, Michal Valko, Alessandro Lazaric +1
A popular approach to apprenticeship learning (AL) is to formulate it as an inverse reinforcement learning (IRL) problem. The MaxEnt-IRL algorithm successfully integrates the maxim…
Synthetic Dialogue Generation for Interactive Conversational Elicitation & Recommendation (ICER)
Moonkyung Ryu, Chih-Wei Hsu, Yinlam Chow +2
While language models (LMs) offer great potential for conversational recommender systems (CRSs), the paucity of public CRS data makes fine-tuning LMs for CRSs challenging. In respo…
Ordering-based Conditions for Global Convergence of Policy Gradient Methods
Jincheng Mei, Bo Dai, Alekh Agarwal +3
We prove that, for finite-arm bandits with linear function approximation, the global convergence of policy gradient (PG) methods depends on inter-related properties between the pol…
Maximum Entropy Model Correction in Reinforcement Learning
Amin Rakhsha, Mete Kemertas, Mohammad Ghavamzadeh +1
We propose and theoretically analyze an approach for planning with an approximate model in reinforcement learning that can reduce the adverse impact of model error. If the model is…
Preference Elicitation with Soft Attributes in Interactive Recommendation
Erdem Biyik, Fan Yao, Yinlam Chow +4
Preference elicitation plays a central role in interactive recommender systems. Most preference elicitation approaches use either item queries that ask users to select preferred it…
Factual and Personalized Recommendations using Language Models and Reinforcement Learning
Jihwan Jeong, Yinlam Chow, Guy Tennenholtz +4
Recommender systems (RSs) play a central role in connecting users to content, products, and services, matching candidate items to users based on their preferences. While traditiona…
Bayesian Regret Minimization in Offline Bandits
Marek Petrik, Guy Tennenholtz, Mohammad Ghavamzadeh
We study how to make decisions that minimize Bayesian regret in offline linear bandits. Prior work suggests that one must take actions with maximum lower confidence bound (LCB) on…
Private and Communication-Efficient Algorithms for Entropy Estimation
Gecia Bravo-Hermsdorff, Róbert Busa-Fekete, Mohammad Ghavamzadeh +2
Modern statistical estimation is often performed in a distributed setting where each sample belongs to a single user who shares their data with a central server. Users are typicall…
DPOK: Reinforcement Learning for Fine-tuning Text-to-Image Diffusion Models
Ying Fan, Olivia Watkins, Yuqing Du +7
Learning from human feedback has been shown to improve text-to-image models. These techniques first learn a reward function that captures what humans care about in the task and the…
A Review of Deep Learning for Video Captioning
Moloud Abdar, Meenakshi Kollati, Swaraja Kuraparthi +8
Video captioning (VC) is a fast-moving, cross-disciplinary area of research that bridges work in the fields of computer vision, natural language processing (NLP), linguistics, and…
On Dynamic Programming Decompositions of Static Risk Measures in Markov Decision Processes
Jia Lin Hau, Erick Delage, Mohammad Ghavamzadeh +1
Optimizing static risk-averse objectives in Markov decision processes is difficult because they do not admit standard dynamic programming equations common in Reinforcement Learning…
Aligning Text-to-Image Models using Human Feedback
Kimin Lee, Hao Liu, Moonkyung Ryu +6
Deep generative models have shown impressive results in text-to-image synthesis. However, current text-to-image models often generate images that are inadequately aligned with text…
Offline Reinforcement Learning for Mixture-of-Expert Dialogue Management
Dhawal Gupta, Yinlam Chow, Aza Tulepbergenov +2
Reinforcement learning (RL) has shown great promise for developing dialogue management (DM) agents that are non-myopic, conduct rich conversations, and maximize overall user satisf…
Multi-Task Off-Policy Learning from Bandit Feedback
Joey Hong, Branislav Kveton, Sumeet Katariya +2
Many practical applications, such as recommender systems and learning to rank, involve solving multiple similar tasks. One example is learning of recommendation policies for users…
Operator Splitting Value Iteration
Amin Rakhsha, Andrew Wang, Mohammad Ghavamzadeh +1
We introduce new planning and reinforcement learning algorithms for discounted MDPs that utilize an approximate model of the environment to accelerate the convergence of the value…
RASR: Risk-Averse Soft-Robust MDPs with EVaR and Entropic Risk
Jia Lin Hau, Marek Petrik, Mohammad Ghavamzadeh +1
Prior work on safe Reinforcement Learning (RL) has studied risk-aversion to randomness in dynamics (aleatory) and to model uncertainty (epistemic) in isolation. We propose and anal…
Robust Reinforcement Learning using Offline Data
Kishan Panaganti, Zaiyan Xu, Dileep Kalathil +1
The goal of robust reinforcement learning (RL) is to learn a policy that is robust against the uncertainty in model parameters. Parameter uncertainty commonly occurs in many real-w…
A Mixture-of-Expert Approach to RL-based Dialogue Management
Yinlam Chow, Aza Tulepbergenov, Ofir Nachum +3
Despite recent advancements in language models (LMs), their application to dialogue management (DM) problems and ability to carry on rich conversations remain a challenge. We use r…
Collaborative Multi-agent Stochastic Linear Bandits
Ahmadreza Moradipari, Mohammad Ghavamzadeh, Mahnoosh Alizadeh
We study a collaborative multi-agent stochastic linear bandit setting, where agents that form a network communicate locally to minimize their overall regret. In this setting, e…
Multi-Environment Meta-Learning in Stochastic Linear Bandits
Ahmadreza Moradipari, Mohammad Ghavamzadeh, Taha Rajabzadeh +2
In this work we investigate meta-learning (or learning-to-learn) approaches in multi-task linear stochastic bandit problems that can originate from multiple environments. Inspired…
Efficient Risk-Averse Reinforcement Learning
Ido Greenberg, Yinlam Chow, Mohammad Ghavamzadeh +1
In risk-averse reinforcement learning (RL), the goal is to optimize some risk measure of the returns. A risk measure often focuses on the worst returns out of the agent's experienc…
Deep Hierarchy in Bandits
Joey Hong, Branislav Kveton, Sumeet Katariya +2
Mean rewards of actions are often correlated. The form of these correlations may be complex and unknown a priori, such as the preferences of a user for recommended products and the…
Non-stationary Bandits and Meta-Learning with a Small Set of Optimal Arms
MohammadJavad Azizi, Thang Duong, Yasin Abbasi-Yadkori +3
We study a sequential decision problem where the learner faces a sequence of -armed bandit tasks. The task boundaries might be known (the bandit meta-learning setting), or unkno…