Optimizing Distributed Tensor Contractions using Node-Aware Processor Grids

Andreas Irmler, Raghavendra Kanakagiri, Sebastian T. Ohlmann +2

We propose an algorithm that aims at minimizing the inter-node communication volume for distributed and memory-efficient tensor contraction schemes on modern multi-core compute nod…