Experimentally Evaluating the Resource Efficiency of Big Data Autoscaling

Jonathan Will, Nico Treide, Lauritz Thamsen +1

Distributed dataflow systems like Spark and Flink enable data-parallel processing of large datasets on clusters. Yet, selecting appropriate computational resources for dataflow job…