activity
20172023
most citedSoftmax Deep Double Deterministic Policy Gradients

47 citations · 264 across the 23 of their papers we have counts for

collaborators

23 papers

cs.IR2023★ 7 cited

A Large Language Model Enhanced Conversational Recommender System

Yue Feng, Shuchang Liu, Zhenghai Xue +5

Conversational recommender systems (CRSs) aim to recommend high-quality items to users through a dialogue interface. It usually contains multiple sub-tasks, such as user preference…

cs.IR2023★ 18 cited

Generative Flow Network for Listwise Recommendation

Shuchang Liu, Qingpeng Cai, Zhankui He +5

Personalized recommender systems fulfill the daily demands of customers and boost online businesses. The goal is to learn a policy that can generate a list of items that matches th…

cs.LG2023★ 2 cited

State Regularized Policy Optimization on Data with Dynamics Shift

Zhenghai Xue, Qingpeng Cai, Shuchang Liu +4

In many real-world scenarios, Reinforcement Learning (RL) algorithms are trained on data with dynamics shift, i.e., with different underlying environment dynamics. A majority of cu…

cs.IR2023★ 45 cited

Multi-Task Recommendations with Reinforcement Learning

Ziru Liu, Jiejie Tian, Qingpeng Cai +8

In recent years, Multi-task Learning (MTL) has yielded immense success in Recommender System (RS) applications. However, current MTL-based recommendation models tend to disregard t…

cs.LG2023★ 4 cited

Reinforcing User Retention in a Billion Scale Short Video Recommender System

Qingpeng Cai, Shuchang Liu, Xueliang Wang +6

Recently, short video platforms have achieved rapid user growth by recommending interesting content to users. The objective of the recommendation is to optimize user retention, the…

cs.IR2023★ 41 cited

Exploration and Regularization of the Latent Action Space in Recommendation

Shuchang Liu, Qingpeng Cai, Bowen Sun +7

In recommender systems, reinforcement learning solutions have effectively boosted recommendation performance because of their ability to capture long-term user-system interaction.…

cs.LG2023★ 2 cited

Two-Stage Constrained Actor-Critic for Short Video Recommendation

Qingpeng Cai, Zhenghai Xue, Chi Zhang +9

The wide popularity of short videos on social media poses new opportunities and challenges to optimize recommender systems on the video-sharing platforms. Users sequentially intera…

cs.IR2022★ 3 cited

PrefRec: Recommender Systems with Human Preferences for Reinforcing Long-term User Engagement

Wanqi Xue, Qingpeng Cai, Zhenghai Xue +6

Current advances in recommender systems have been remarkably successful in optimizing immediate engagement. However, long-term user engagement, a more desirable performance metric,…

cs.IR2022★ 6 cited

ResAct: Reinforcing Long-term Engagement in Sequential Recommendation with Residual Actor

Wanqi Xue, Qingpeng Cai, Ruohan Zhan +4

Long-term engagement is preferred over immediate engagement in sequential recommendation as it directly affects product operational metrics such as daily active users (DAUs) and dw…

cs.LG2022★ 5 cited

Constrained Reinforcement Learning for Short Video Recommendation

Qingpeng Cai, Ruohan Zhan, Chi Zhang +5

The wide popularity of short videos on social media poses new opportunities and challenges to optimize recommender systems on the video-sharing platforms. Users provide complex and…

cs.CV2021★ 7 cited

MAGIC: Multimodal relAtional Graph adversarIal inferenCe for Diverse and Unpaired Text-based Image Captioning

Wenqiao Zhang, Haochen Shi, Jiannan Guo +5

Text-based image captioning (TextCap) requires simultaneous comprehension of visual content and reading the text of images to generate a natural language description. Although a ta…

cs.LG2021

A Survey on Deep Reinforcement Learning for Data Processing and Analytics

Qingpeng Cai, Can Cui, Yiyuan Xiong +3

Data processing and analytics are fundamental and pervasive. Algorithms play a vital role in data processing and analytics where many algorithm designs have incorporated heuristics…

cs.LG2020★ 47 cited

Softmax Deep Double Deterministic Policy Gradients

Ling Pan, Qingpeng Cai, Longbo Huang

A widely-used actor-critic reinforcement learning algorithm for continuous control, Deep Deterministic Policy Gradients (DDPG), suffers from the overestimation problem, which can n…

cs.LG2020★ 2 cited

Generator and Critic: A Deep Reinforcement Learning Approach for Slate Re-ranking in E-commerce

Jianxiong Wei, Anxiang Zeng, Yueqiu Wu +3

The slate re-ranking problem considers the mutual influences between items to improve user satisfaction in e-commerce, compared with the point-wise ranking. Previous works either d…

cs.LG2019★ 3 cited

Multi-Path Policy Optimization

Ling Pan, Qingpeng Cai, Longbo Huang

Recent years have witnessed a tremendous improvement of deep reinforcement learning. However, a challenging problem is that an agent may suffer from inefficient exploration, partic…

cs.LG2019

Deterministic Value-Policy Gradients

Qingpeng Cai, Ling Pan, Pingzhong Tang

Reinforcement learning algorithms such as the deep deterministic policy gradient algorithm (DDPG) has been widely used in continuous control tasks. However, the model-free DDPG alg…

cs.LG2019★ 19 cited

Reinforcement Learning Driven Heuristic Optimization

Qingpeng Cai, Will Hang, Azalia Mirhoseini +3

Heuristic algorithms such as simulated annealing, Concorde, and METIS are effective and widely used approaches to find solutions to combinatorial optimization problems. However, th…

cs.LG2019★ 3 cited

Reinforcement Learning with Dynamic Boltzmann Softmax Updates

Ling Pan, Qingpeng Cai, Qi Meng +3

Value function estimation is an important task in reinforcement learning, i.e., prediction. The Boltzmann softmax operator is a natural value estimator and can provide several bene…

cs.LG2018★ 2 cited

Policy Optimization with Model-based Explorations

Feiyang Pan, Qingpeng Cai, An-Xiang Zeng +5

Model-free reinforcement learning methods such as the Proximal Policy Optimization algorithm (PPO) have successfully applied in complex decision-making problems such as Atari games…

cs.LG2018★ 1 cited

Deterministic Policy Gradients With General State Transitions

Qingpeng Cai, Ling Pan, Pingzhong Tang

We study a reinforcement learning setting, where the state transition function is a convex combination of a stochastic continuous function and a deterministic function. Such a sett…

cs.AI2018★ 23 cited

A Deep Reinforcement Learning Framework for Rebalancing Dockless Bike Sharing Systems

Ling Pan, Qingpeng Cai, Zhixuan Fang +2

Bike sharing provides an environment-friendly way for traveling and is booming all over the world. Yet, due to the high similarity of user travel patterns, the bike imbalance probl…

cs.LG2018★ 21 cited

Policy Gradients for Contextual Recommendations

Feiyang Pan, Qingpeng Cai, Pingzhong Tang +2

Decision making is a challenging task in online recommender systems. The decision maker often needs to choose a contextual item at each step from a set of candidates. Contextual ba…

cs.MA2017★ 3 cited

Reinforcement Mechanism Design for e-commerce

Qingpeng Cai, Aris Filos-Ratsikas, Pingzhong Tang +1

We study the problem of allocating impressions to sellers in e-commerce websites, such as Amazon, eBay or Taobao, aiming to maximize the total revenue generated by the platform. We…