Deep Learning based Large Scale Visual Recommendation and Search for E-Commerce

Abstract

In this paper, we present a unified end-to-end approach to build a large scale Visual Search and Recommendation system for e-commerce. Previous works have targeted these problems in isolation. We believe a more effective and elegant solution could be obtained by tackling them together. We propose a unified Deep Convolutional Neural Network architecture, called VisNet, to learn embeddings to capture the notion of visual similarity, across several semantic granularities. We demonstrate the superiority of our approach for the task of image retrieval, by comparing against the state-of-the-art on the Exact Street2Shop dataset. We then share the design decisions and trade-offs made while deploying the model to power Visual Recommendations across a catalog of 50M products, supporting 2K queries a second at Flipkart, India's largest e-commerce company. The deployment of our solution has yielded a significant business impact, as measured by the conversion-rate.

References in corpus (1)

• Simultaneous Feature Learning and Hash Coding with Deep Neural Networks

Cited by in corpus (18)

• Leveraging Weakly Annotated Data for Fashion Image Retrieval and Label Prediction
• Fine-Grained Fashion Similarity Prediction by Attribute-Specific Embedding Learning
• Visually Explainable Recommendation
• Energy-based error bound of physics-informed neural network solutions in elasticity
• Preferences Prediction using a Gallery of Mobile Device based on Scene Recognition and Object Detection
• Towards Zero-shot Cross-lingual Image Retrieval
• Minimizing FLOPs to Learn Efficient Sparse Representations
• Layer-wise Relevance Propagation for Explainable Recommendations
• Towards Zero-shot Cross-lingual Image Retrieval and Tagging
• Searching for Apparel Products from Images in the Wild
• Multi-Modal Retrieval using Graph Neural Networks
• Fine-Grained Fashion Similarity Learning by Attribute-Specific Embedding Network
• Using Image Fairness Representations in Diversity-Based Re-ranking for Recommendations
• The Resale Price Prediction of Secondhand Jewelry Items Using a Multi-modal Deep Model with Iterative Co-Attention
• FashionSearchNet-v2: Learning Attribute Representations with Localization for Image Retrieval with Attribute Manipulation
• Visually Aware Skip-Gram for Image Based Recommendations
• Recommendation or Discrimination?: Quantifying Distribution Parity in Information Retrieval Systems
• Domain invariant hierarchical embedding for grocery products recognition