Variational Policy for Guiding Point Processes
arXiv:1701.08585
Abstract
Temporal point processes have been widely applied to model event sequence data generated by online users. In this paper, we consider the problem of how to design the optimal control policy for point processes, such that the stochastic system driven by the point process is steered to a target state. In particular, we exploit the key insight to view the stochastic optimal control problem from the perspective of optimal measure and variational inference. We further propose a convex optimization framework and an efficient algorithm to update the policy adaptively to the current system state. Experiments on synthetic and real-world data show that our algorithm can steer the user activities much more accurately and efficiently than other stochastic control methods.
ICML 2017
References in corpus (7)
- Path Integral Policy Improvement with Covariance Matrix Adaptation
- Deep Coevolutionary Network: Embedding User and Item Features for Recommendation
- Learning and Forecasting Opinion Dynamics in Social Networks
- Smart broadcasting: Do you want to be seen?
- Fast and Simple Optimization for Poisson Likelihood Models
- A Stochastic Differential Equation Framework for Guiding Online User Activities in Closed Loop
- RedQueen: An Online Algorithm for Smart Broadcasting in Social Networks