Balancing Fairness and Performance in Multi-User Spark Workloads with Dynamic Scheduling (extended version)

Dāvis Kažemaks, Laurens Versluis, Burcu Kulahcioglu Ozkan +1

Apache Spark is a widely adopted framework for large-scale data processing. However, in industrial analytics environments, Spark's built-in schedulers, such as FIFO and fair schedu…