Large-Scale User Modeling with Recurrent Neural Networks for Music Discovery on Multiple Time Scales
arXiv:1708.06520 · doi:10.1007/s11042-017-5121-z
Abstract
The amount of content on online music streaming platforms is immense, and most users only access a tiny fraction of this content. Recommender systems are the application of choice to open up the collection to these users. Collaborative filtering has the disadvantage that it relies on explicit ratings, which are often unavailable, and generally disregards the temporal nature of music consumption. On the other hand, item co-occurrence algorithms, such as the recently introduced word2vec-based recommenders, are typically left without an effective user representation. In this paper, we present a new approach to model users through recurrent neural networks by sequentially processing consumed items, represented by any type of embeddings and other context features. This way we obtain semantically rich user representations, which capture a user's musical taste over time. Our experimental analysis on large-scale user data shows that our model can be used to predict future songs a user will likely listen to, both in the short and long term.
arXiv commentAuthor pre-print version, 20 pages, 6 figures, 4 tables
References in corpus (10)
- Distributed Representations of Words and Phrases and their Compositionality
- Sequence to Sequence Learning with Neural Networks
- Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling
- LSTM: A Search Space Odyssey
- Natural Language Processing (almost) from Scratch
- BPR: Bayesian Personalized Ranking from Implicit Feedback
- Visualizing and Understanding Recurrent Networks
- Representation learning for very short texts using weighted word embedding aggregation
- Improved Recurrent Neural Networks for Session-based Recommendations
- From Word Embeddings to Item Recommendation