56 citations · 117 across the 9 of their papers we have counts for
4 papers · 1 filter
Towards General and Efficient Online Tuning for Spark
Yang Li, Huaijun Jiang, Yu Shen +8
The distributed data analytic system -- Spark is a common choice for processing massive volumes of heterogeneous data, while it is challenging to tune its parameters to achieve hig…
MindOpt Tuner: Boost the Performance of Numerical Software by Automatic Parameter Tuning
Mengyuan Zhang, Wotao Yin, Mengchang Wang +7
Numerical software is usually shipped with built-in hyperparameters. By carefully tuning those hyperparameters, significant performance enhancements can be achieved for specific ap…
OpenBox: A Python Toolkit for Generalized Black-box Optimization
Huaijun Jiang, Yu Shen, Yang Li +5
Black-box optimization (BBO) has a broad range of applications, including automatic machine learning, experimental design, and database knob tuning. However, users still face chall…
Rover: An online Spark SQL tuning service via generalized transfer learning
Yu Shen, Xinyuyang Ren, Yupeng Lu +6
Distributed data analytic engines like Spark are common choices to process massive data in industry. However, the performance of Spark SQL highly depends on the choice of configura…