Efficient and Joint Hyperparameter and Architecture Search for Collaborative Filtering
arXiv:2307.11004 · doi:10.1145/3580305.3599322
Abstract
Automated Machine Learning (AutoML) techniques have recently been introduced to design Collaborative Filtering (CF) models in a data-specific manner. However, existing works either search architectures or hyperparameters while ignoring the fact they are intrinsically related and should be considered together. This motivates us to consider a joint hyperparameter and architecture search method to design CF models. However, this is not easy because of the large search space and high evaluation cost. To solve these challenges, we reduce the space by screening out usefulness yperparameter choices through a comprehensive understanding of individual hyperparameters. Next, we propose a two-stage search algorithm to find proper configurations from the reduced space. In the first stage, we leverage knowledge from subsampled datasets to reduce evaluation costs; in the second stage, we efficiently fine-tune top candidate models on the whole dataset. Extensive experiments on real-world datasets show better performance can be achieved compared with both hand-designed and previous searched models. Besides, ablation and case studies demonstrate the effectiveness of our search framework.
arXiv commentAccepted by KDD 2023
References in corpus (7)
- Graph Convolutional Neural Networks for Web-Scale Recommender Systems
- Self-supervised Graph Learning for Recommendation
- Are We Really Making Much Progress? A Worrying Analysis of Recent Neural Recommendation Approaches
- Automated Machine Learning: From Principles to Practices
- A Comprehensive Survey on Automated Machine Learning for Recommendations
- KGTuner: Efficient Hyper-parameter Search for Knowledge Graph Learning
- AutoML for Deep Recommender Systems: A Survey