152 citations · 315 across the 17 of their papers we have counts for
6 papers · 1 filter
Towards General and Efficient Online Tuning for Spark
Yang Li, Huaijun Jiang, Yu Shen +8
The distributed data analytic system -- Spark is a common choice for processing massive volumes of heterogeneous data, while it is challenging to tune its parameters to achieve hig…
OpenBox: A Python Toolkit for Generalized Black-box Optimization
Huaijun Jiang, Yu Shen, Yang Li +5
Black-box optimization (BBO) has a broad range of applications, including automatic machine learning, experimental design, and database knob tuning. However, users still face chall…
A Unified and Efficient Coordinating Framework for Autonomous DBMS Tuning
Xinyi Zhang, Zhuo Chang, Hong Wu +5
Recently using machine learning (ML) based techniques to optimize modern database management systems has attracted intensive interest from both industry and academia. With an objec…
Transfer Learning for Bayesian Optimization: A Survey
Tianyi Bai, Yang Li, Yu Shen +3
A wide spectrum of design and decision problems, including parameter tuning, A/B testing and drug design, intrinsically are instances of black-box optimization. Bayesian optimizati…
DivBO: Diversity-aware CASH for Ensemble Learning
Yu Shen, Yupeng Lu, Yang Li +3
The Combined Algorithm Selection and Hyperparameters optimization (CASH) problem is one of the fundamental problems in Automated Machine Learning (AutoML). Motivated by the success…
Rover: An online Spark SQL tuning service via generalized transfer learning
Yu Shen, Xinyuyang Ren, Yupeng Lu +6
Distributed data analytic engines like Spark are common choices to process massive data in industry. However, the performance of Spark SQL highly depends on the choice of configura…