Efficient MPI-based Communication for GPU-Accelerated Dask Applications

Aamir Shafi, Jahanzeb Maqbool Hashmi, Hari Subramoni +1

Dask is a popular parallel and distributed computing framework, which rivals Apache Spark to enable task-based scalable processing of big data. The Dask Distributed library forms t…