Work

Block-structured matrix reordering for efficient SDDMM on tensor cores

Year: 2026

Type: article

Abstract: Sampled Dense-Dense Matrix Multiplication is a fundamental operation in sparse linear algebra, widely used in graph neural networks and scientific computing. However, accelerating computations on GPUs is challenging due to data sparsity and irregular memory access, which hinder efficient use of Tensor Cores. This paper introduces a Block-Structured Matrix Reordering framework that improves Tensor Core utilization by reorganizing sparse matrices using bi-directional reordering with weighted similarity metrics. We also propose a tile-aware sparse matrix format that improves memory access and task scheduling. To enable adaptive and balanced computation, we employ a dual-path execution strategy: dense matrix blocks are assigned to Tensor Cores, while sparse blocks are handled by CUDA Cores. Experiments on the RTX 4090 demonstrate that our method achieves up to a $$10.38\times $$ speedup over the best Tensor Core baseline and $$7.31\times $$ over the best CUDA Core baseline by producing denser block structures and enhancing parallelism.

Source: The Journal of Supercomputing

DOI: 10.1007/s11227-026-08606-2

Authors: Chengxing Zou, Changwan Hong, Gordon Euhyun Moon, Jinsung Kim

Institutions: Chung-Ang University, MIT Computer Science and Artificial Intelligence Laboratory, Massachusetts Institute of Technology, Sogang University

Language: English

Topic: Parallel Computing and Optimization Techniques

Subfield: Hardware and Architecture

Field: Computer Science

Domain: Physical Sciences

Open Access status: hybrid

Estimated APC paid: $3,290

Funders: National Research Foundation, National Research Foundation of Korea, Ministry of Science and ICT, South Korea