112 citations · 448 across the 20 of their papers we have counts for
20 papers
A Unified and Efficient Coordinating Framework for Autonomous DBMS Tuning
Xinyi Zhang, Zhuo Chang, Hong Wu +5
Recently using machine learning (ML) based techniques to optimize modern database management systems has attracted intensive interest from both industry and academia. With an objec…
Transfer Learning for Bayesian Optimization: A Survey
Tianyi Bai, Yang Li, Yu Shen +3
A wide spectrum of design and decision problems, including parameter tuning, A/B testing and drug design, intrinsically are instances of black-box optimization. Bayesian optimizati…
Efficient End-to-End AutoML via Scalable Search Space Decomposition
Yang Li, Yu Shen, Wentao Zhang +2
End-to-end AutoML has attracted intensive interests from both academia and industry which automatically searches for ML pipelines in a space induced by feature engineering, algorit…
NAFS: A Simple yet Tough-to-beat Baseline for Graph Representation Learning
Wentao Zhang, Zeang Sheng, Mingyu Yang +4
Recently, graph neural networks (GNNs) have shown prominent performance in graph representation learning by leveraging knowledge from both graph structure and node features. Howeve…
Graph Attention Multi-Layer Perceptron
Wentao Zhang, Ziqi Yin, Zeang Sheng +6
Graph neural networks (GNNs) have achieved great success in many graph-based applications. However, the enormous size and high sparsity level of graphs hinder their applications un…
TransBO: Hyperparameter Optimization via Two-Phase Transfer Learning
Yang Li, Yu Shen, Huaijun Jiang +4
With the extensive applications of machine learning models, automatic hyperparameter optimization (HPO) has become increasingly important. Motivated by the tuning behaviors of huma…
Transfer Learning based Search Space Design for Hyperparameter Tuning
Yang Li, Yu Shen, Huaijun Jiang +4
The tuning of hyperparameters becomes increasingly important as machine learning (ML) models have been extensively applied in data mining applications. Among various approaches, Ba…
Towards Dynamic and Safe Configuration Tuning for Cloud Databases
Xinyi Zhang, Hong Wu, Yang Li +3
Configuration knobs of database systems are essential to achieve high throughput and low latency. Recently, automatic tuning systems using machine learning methods (ML) have shown…
Hyper-Tune: Towards Efficient Hyper-parameter Tuning at Scale
Yang Li, Yu Shen, Huaijun Jiang +5
The ever-growing demand and complexity of machine learning are putting pressure on hyper-parameter tuning systems: while the evaluation cost of models continues to increase, the sc…
Automated Hyperparameter Optimization Challenge at CIKM 2021 AnalyticCup
Huaijun Jiang, Yu Shen, Yang Li
In this paper, we describe our method for tackling the automated hyperparameter optimization challenge in QQ Browser 2021 AI Algorithm Competiton (ACM CIKM 2021 AnalyticCup Track 2…
Node Dependent Local Smoothing for Scalable Graph Learning
Wentao Zhang, Mingyu Yang, Zeang Sheng +5
Recent works reveal that feature or label smoothing lies at the core of Graph Neural Networks (GNNs). Concretely, they show feature smoothing combined with simple linear regression…
Facilitating Database Tuning with Hyper-Parameter Optimization: A Comprehensive Experimental Evaluation
Xinyi Zhang, Zhuo Chang, Yang Li +4
Recently, using automatic configuration tuning to improve the performance of modern database management systems (DBMSs) has attracted increasing interest from the database communit…
ProxyBO: Accelerating Neural Architecture Search via Bayesian Optimization with Zero-cost Proxies
Yu Shen, Yang Li, Jian Zheng +6
Designing neural architectures requires immense manual efforts. This has promoted the development of neural architecture search (NAS) to automate the design. While previous NAS met…
Grain: Improving Data Efficiency of Graph Neural Networks via Diversified Influence Maximization
Wentao Zhang, Zhi Yang, Yexin Wang +4
Data selection methods, such as active learning and core-set selection, are useful tools for improving the data efficiency of deep learning models on large-scale datasets. However,…
ROD: Reception-aware Online Distillation for Sparse Graphs
Wentao Zhang, Yuezihan Jiang, Yang Li +6
Graph neural networks (GNNs) have been widely used in many graph-based tasks such as node classification, link prediction, and node clustering. However, GNNs gain their performance…
VolcanoML: Speeding up End-to-End AutoML via Scalable Search Space Decomposition
Yang Li, Yu Shen, Wentao Zhang +8
End-to-end AutoML has attracted intensive interests from both academia and industry, which automatically searches for ML pipelines in a space induced by feature engineering, algori…
OpenBox: A Generalized Black-box Optimization Service
Yang Li, Yu Shen, Wentao Zhang +9
Black-box optimization (BBO) has a broad range of applications, including automatic machine learning, engineering, physics, and experimental design. However, it remains a challenge…
GMLP: Building Scalable and Flexible Graph Neural Networks with Feature-Message Passing
Wentao Zhang, Yu Shen, Zheyu Lin +6
In recent studies, neural message passing has proved to be an effective way to design graph neural networks (GNNs), which have achieved state-of-the-art performance in many graph-b…
Efficient Automatic CASH via Rising Bandits
Yang Li, Jiawei Jiang, Jinyang Gao +3
The Combined Algorithm Selection and Hyperparameter optimization (CASH) is one of the most fundamental problems in Automatic Machine Learning (AutoML). The existing Bayesian optimi…
MFES-HB: Efficient Hyperband with Multi-Fidelity Quality Measurements
Yang Li, Yu Shen, Jiawei Jiang +3
Hyperparameter optimization (HPO) is a fundamental problem in automatic machine learning (AutoML). However, due to the expensive evaluation cost of models (e.g., training deep lear…