The Tiny-Tasks Granularity Trade-Off: Balancing overhead vs. performance in parallel systems

Stefan Bora, Brenton Walker, Markus Fidler

Models of parallel processing systems typically assume that one has $l$ workers and jobs are split into an equal number of $k=l$ tasks. Splitting jobs into $k>l$ smaller tasks, i…