works on
apache spark 1benchmark evaluation 1cost-performance tradeoff 1executor allocation 1stage-level scheduling 1tree ensemble models 1

From the 1 of 1 linked paper with an AI index.

collaborators
Showing cs.DCShow all

1 paper · 1 filter

cs.DC2026

Stage-Level Executor Allocation in Apache Spark with Cost-Performance Trade-offs

Miriam Rateike, Isaac Waweru Wambugu, Celia Cintas +3

The paper introduces a stage‑level executor allocation method for serverless Apache Spark that uses tree‑ensemble models to predict runtime and cost, letting users specify cost‑per…