Sequential Variational Autoencoders for Collaborative Filtering
arXiv:1811.09975
Abstract
Variational autoencoders were proven successful in domains such as computer vision and speech processing. Their adoption for modeling user preferences is still unexplored, although recently it is starting to gain attention in the current literature. In this work, we propose a model which extends variational autoencoders by exploiting the rich information present in the past preference history. We introduce a recurrent version of the VAE, where instead of passing a subset of the whole history regardless of temporal dependencies, we rather pass the consumption sequence subset through a recurrent neural network. At each time-step of the RNN, the sequence is fed through a series of fully-connected layers, the output of which models the probability distribution of the most likely future preferences. We show that handling temporal information is crucial for improving the accuracy of the VAE: In fact, our model beats the current state-of-the-art by valuable margins because of its ability to capture temporal dependencies among the user-consumption sequence using the recurrent encoder still keeping the fundamentals of variational autoencoders intact.
9 pages, 6 figures, 2 tables, WSDM2019
References in corpus (14)
- Adam: A Method for Stochastic Optimization
- Auto-Encoding Variational Bayes
- Neural Machine Translation by Jointly Learning to Align and Translate
- Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling
- LSTM: A Search Space Odyssey
- BPR: Bayesian Personalized Ranking from Implicit Feedback
- Stochastic Backpropagation and Approximate Inference in Deep Generative Models
- Translation-based Recommendation
- Neural Collaborative Filtering
- Learning Stochastic Recurrent Networks
- Fusing Similarity Models with Markov Chains for Sparse Sequential Recommendation
- Improved Recurrent Neural Networks for Session-based Recommendations
- Context-aware Sequential Recommendation
- A Hybrid Variational Autoencoder for Collaborative Filtering