Tutorial and Survey on Probabilistic Graphical Model and Variational Inference in Deep Reinforcement Learning
arXiv:1908.09381
Abstract
Aiming at a comprehensive and concise tutorial survey, recap of variational inference and reinforcement learning with Probabilistic Graphical Models are given with detailed derivations. Reviews and comparisons on recent advances in deep reinforcement learning are made from various aspects. We offer detailed derivations to a taxonomy of Probabilistic Graphical Model and Variational Inference methods in deep reinforcement learning, which serves as a complementary material on top of the original contributions.
arXiv comment2019 IEEE Symposium on Computational Intelligence, Symposium on Adaptive Dynamic Programming and Reinforcement Learning
References in corpus (16)
- Continuous control with deep reinforcement learning
- Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actor
- Prioritized Experience Replay
- Tutorial on Variational Autoencoders
- Weight Uncertainty in Neural Networks
- The Concrete Distribution: A Continuous Relaxation of Discrete Random Variables
- VIME: Variational Information Maximizing Exploration
- Reinforcement Learning and Control as Probabilistic Inference: Tutorial and Review
- Hindsight Experience Replay
- Self-Consistent Trajectory Autoencoder: Hierarchical Reinforcement Learning with Trajectory Embeddings
- Maximum Entropy-Regularized Multi-Goal Reinforcement Learning
- Efficient Model-Based Deep Reinforcement Learning with Variational State Tabulation
- Planning to Be Surprised: Optimal Bayesian Exploration in Dynamic Environments
- ReinBo: Machine Learning pipeline search and configuration with Bayesian Optimization embedded Reinforcement Learning
- High Dimensional Restrictive Federated Model Selection with multi-objective Bayesian Optimization over shifted distributions
- Variational Resampling Based Assessment of Deep Neural Networks under Distribution Shift