Visually Aware Skip-Gram for Image Based Recommendations

Abstract

The visual appearance of a product significantly influences purchase decisions on e-commerce websites. We propose a novel framework VASG (Visually Aware Skip-Gram) for learning user and product representations in a common latent space using product image features. Our model is an amalgamation of the Skip-Gram architecture and a deep neural network based Decoder. Here the Skip-Gram attempts to capture user preference by optimizing user-product co-occurrence in a Heterogeneous Information Network while the Decoder simultaneously learns a mapping to transform product image features to the Skip-Gram embedding space. This architecture is jointly optimized in an end-to-end, multitask fashion. The proposed framework enables us to make personalized recommendations for cold-start products which have no purchase history. Experiments conducted on large real-world datasets show that the learned embeddings can generate effective recommendations using nearest neighbour searches.

arXiv comment8 pages, 5 figures

References in corpus (8)

• Efficient Estimation of Word Representations in Vector Space
• Distributed Representations of Words and Phrases and their Compositionality
• BPR: Bayesian Personalized Ranking from Implicit Feedback
• Multi-Task Learning Using Uncertainty to Weigh Losses for Scene Geometry and Semantics
• MMALFM: Explainable Recommendation by Leveraging Reviews and Images
• Deep Learning based Large Scale Visual Recommendation and Search for E-Commerce
• Sherlock: Sparse Hierarchical Embeddings for Visually-aware One-class Collaborative Filtering
• JNET: Learning User Representations via Joint Network Embedding and Topic Embedding