Work

Distributed Parallelization of xPU Stencil Computations in Julia

Year: 2024

Type: article

Abstract: We present a straightforward approach for distributed parallelization of stencil-based xPU applications on a regular staggered grid, which is instantiated in the package ImplicitGlobalGrid.jl.The approach allows to leverage remote direct memory access and enables close to ideal weak scaling of real-world applications on thousands of GPUs.The communication costs can be easily hidden behind computation.

Source: JuliaCon Proceedings

DOI: 10.21105/jcon.00137

Authors: Samuel Omlin, Ludovic Räss, Ivan Utkin

Institutions: ETH Zurich, CSCS - Swiss National Supercomputing Centre, Swiss Federal Institute for Forest, Snow and Landscape Research, Laboratory of Hydraulics, Hydrology and Glaciology

Language: English

Topic: Parallel Computing and Optimization Techniques

Subfield: Hardware and Architecture

Field: Computer Science

Domain: Physical Sciences

Open Access status: diamond

Funders: Centro Svizzero di Calcolo Scientifico, National Supercomputing Centre Singapore

OpenAlex ID: W4404602398