Taco Tensor Algebra kernels on distributed systems using Legion
Year: 2019
Type: dissertation
Abstract: Tensor algebra is a powerful language for expressing computation on multidimensional data.While many tensor datasets are sparse, most tensor algebra libraries have limited support for handling sparsity.The Tensor Algebra Compiler (Taco) has introduced a taxonomy for sparse tensor formats that has allowed them to compile sparse tensor algebra expressions to performant C code, but they have not taken advantage of distributed systems.This work provides a code generation technique for creating Legion programs that distribute the computation of Taco tensor algebra kernels across distributed systems, and a scheduling language for controlling how this distributed computation is structured.This technique is implemented in the form of a command-line tool called SuperTaco.We perform a strong scaling analysis for the SpMV and TTM kernels under a row blocking distribution schedule, and find speedups of 9-10x when using 20 cores on a single node.For multi-node systems using 20 cores per node, SpMV achieves a 33.3x speedup at 160 cores and TTM achieves a 42.0x speedup at 140 cores.
Author: Shinde, Sachin Dilip.
Language: English
Subfield: Hardware and Architecture
Field: Computer Science
Domain: Physical Sciences
Open Access status: green
OpenAlex ID: W7071693283
