Stage-Level Executor Allocation in Apache Spark with Cost-Performance Trade-offs

Miriam Rateike, Isaac Waweru Wambugu, Celia Cintas +3

Allocating executors (i.e. compute resources) to distributed processing systems must balance resource costs of scaling-out unnecessarily against artificial, performance-limiting bo…