Recurrent Point Review Models

Abstract

Deep neural network models represent the state-of-the-art methodologies for natural language processing. Here we build on top of these methodologies to incorporate temporal information and model how to review data changes with time. Specifically, we use the dynamic representations of recurrent point process models, which encode the history of how business or service reviews are received in time, to generate instantaneous language models with improved prediction capabilities. Simultaneously, our methodologies enhance the predictive power of our point process models by incorporating summarized review content representations. We provide recurrent network and temporal convolution solutions for modeling the review content. We deploy our methodologies in the context of recommender systems, effectively characterizing the change in preference and taste of users as time evolves. Source code is available at [1].

8 pages, 6 figures, Published in: 2020 International Joint Conference on Neural Networks (IJCNN)

References in corpus (14)

• Adam: A Method for Stochastic Optimization
• Distributed Representations of Words and Phrases and their Compositionality
• ADADELTA: An Adaptive Learning Rate Method
• An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modeling
• Weight Normalization: A Simple Reparameterization to Accelerate Training of Deep Neural Networks
• Continuous Time Dynamic Topic Models
• Neural Machine Translation in Linear Time
• TransNets: Learning to Transform for Recommendation
• Neural Variational Inference for Text Processing
• Diachronic Word Embeddings Reveal Statistical Laws of Semantic Change
• The Neural Hawkes Process: A Neurally Self-Modulating Multivariate Point Process
• Modelling, Visualising and Summarising Documents with a Single Convolutional Neural Network
• Structured Neural Topic Models for Reviews
• Recurrent Point Processes for Dynamic Review Models