Cascade Ranking for Operational E-commerce Search
arXiv:1706.02093 · doi:10.1145/3097983.3098011
Abstract
In the 'Big Data' era, many real-world applications like search involve the ranking problem for a large number of items. It is important to obtain effective ranking results and at the same time obtain the results efficiently in a timely manner for providing good user experience and saving computational costs. Valuable prior research has been conducted for learning to efficiently rank like the cascade ranking (learning) model, which uses a sequence of ranking functions to progressively filter some items and rank the remaining items. However, most existing research of learning to efficiently rank in search is studied in a relatively small computing environments with simulated user queries. This paper presents novel research and thorough study of designing and deploying a Cascade model in a Large-scale Operational E-commerce Search application (CLOES), which deals with hundreds of millions of user queries per day with hundreds of servers. The challenge of the real-world application provides new insights for research: 1). Real-world search applications often involve multiple factors of preferences or constraints with respect to user experience and computational costs such as search accuracy, search latency, size of search results and total CPU cost, while most existing search solutions only address one or two factors; 2). Effectiveness of e-commerce search involves multiple types of user behaviors such as click and purchase, while most existing cascade ranking in search only models the click behavior. Based on these observations, a novel cascade ranking model is designed and deployed in an operational e-commerce search application. An extensive set of experiments demonstrate the advantage of the proposed work to address multiple factors of effectiveness, efficiency and user experience in the real-world application.
Cited by in corpus (27)
- Multi-Stage Document Ranking with BERT
- Semantic Models for the First-stage Retrieval: A Comprehensive Review
- Pretrained Transformers for Text Ranking: BERT and Beyond
- Rapidly Bootstrapping a Question Answering Dataset for COVID-19
- The Expando-Mono-Duo Design Pattern for Text Ranking with Pretrained Sequence-to-Sequence Models
- Rapidly Deploying a Neural Search Engine for the COVID-19 Open Research Dataset: Preliminary Thoughts and Lessons Learned
- EENMF: An End-to-End Neural Matching Framework for E-Commerce Sponsored Search
- Model Slicing for Supporting Complex Analytics with Elastic Inference Cost and Resource Constraints
- Learning to Collaborate: Multi-Scenario Ranking via Multi-Agent Reinforcement Learning
- COLD: Towards the Next Generation of Pre-Ranking System
- RL-MPCA: A Reinforcement Learning Based Multi-Phase Computation Allocation Approach for Recommender Systems
- Learning Multi-Stage Multi-Grained Semantic Embeddings for E-Commerce Search
- Covidex: Neural Ranking Models and Keyword Search Infrastructure for the COVID-19 Open Research Dataset
- Towards Personalized and Semantic Retrieval: An End-to-End Solution for E-commerce Search via Embedding Learning
- Rethinking Large-scale Pre-ranking System: Entire-chain Cross-domain Models
- DCAF: A Dynamic Computation Allocation Framework for Online Serving System
- Embedding-based Product Retrieval in Taobao Search
- A Discriminative Semantic Ranker for Question Retrieval
- Privileged Features Distillation at Taobao Recommendations
- Accelerating E-Commerce Search Engine Ranking by Contextual Factor Selection
- Five lessons from building a deep neural network recommender
- Demystifying Core Ranking in Pinterest Image Search
- A Learnable Fully Interacted Two-Tower Model for Pre-Ranking System
- Towards a Better Tradeoff between Effectiveness and Efficiency in Pre-Ranking: A Learnable Feature Selection based Approach
- Learning Cheap and Novel Flight Itineraries
- Optimizing Compound Retrieval Systems
- Deep neural network marketplace recommenders in online experiments