NobleBlocks
Public

Optimizing Distributed Tensor Contractions using Node-Aware Processor Grids

Published in arXiv (Cornell University) • Jul 17, 2023
NobleIDNI9P89W88R06S37
Authors:
Andreas Irmler
,
Raghavendra Kanakagiri
,
Sebastian T. Ohlmann

Abstract

We propose an algorithm that aims at minimizing the inter-node communication volume for distributed and memory-efficient tensor contraction schemes on modern multi-core compute nodes. The key idea is to define processor grids that optimize intra-/inter-node communication volume in the employed contr...

Finding related papers...

Discussions

(0)

No comments yet

Be the first to share your thoughts!