Optimizing Distributed Tensor Contractions using Node-Aware Processor Grids
Published in arXiv (Cornell University) • Jul 17, 2023
NobleIDNI9P89W88R06S37
Authors:,,
Andreas Irmler
Raghavendra Kanakagiri
Sebastian T. Ohlmann
Abstract
We propose an algorithm that aims at minimizing the inter-node communication volume for distributed and memory-efficient tensor contraction schemes on modern multi-core compute nodes. The key idea is to define processor grids that optimize intra-/inter-node communication volume in the employed contr...
Finding related papers...
Discussions
(0)No comments yet
Be the first to share your thoughts!