45 citations · 98 across the 11 of their papers we have counts for
4 papers · 1 filter
Towards General and Efficient Online Tuning for Spark
Yang Li, Huaijun Jiang, Yu Shen +8
The distributed data analytic system -- Spark is a common choice for processing massive volumes of heterogeneous data, while it is challenging to tune its parameters to achieve hig…
OpenBox: A Python Toolkit for Generalized Black-box Optimization
Huaijun Jiang, Yu Shen, Yang Li +5
Black-box optimization (BBO) has a broad range of applications, including automatic machine learning, experimental design, and database knob tuning. However, users still face chall…
DivBO: Diversity-aware CASH for Ensemble Learning
Yu Shen, Yupeng Lu, Yang Li +3
The Combined Algorithm Selection and Hyperparameters optimization (CASH) problem is one of the fundamental problems in Automated Machine Learning (AutoML). Motivated by the success…
Rover: An online Spark SQL tuning service via generalized transfer learning
Yu Shen, Xinyuyang Ren, Yupeng Lu +6
Distributed data analytic engines like Spark are common choices to process massive data in industry. However, the performance of Spark SQL highly depends on the choice of configura…