Work

Programming the Future: the Essential Role of System Topology Awareness in Heterogeneous Disaggregated Environments

Year: 2024

Type: conference-paper

Abstract: Heterogeneous disaggregated systems represent a promising solution to deliver the performance required by next-generation High-Performance Computing (HPC) workloads.Nevertheless, their heterogeneity represents a significant challenge in the application development process, making it urgent to identify solutions to program these systems productively and efficiently without sacrificing performance.In this paper, we explore the potential of system topology information in addressing such a challenge.We delve into the foundations of system topology and how this information could be exploited in high-level programming libraries across all layers of the software infrastructures, from runtime systems to user-facing APIs.We propose K-Nearest Neighbors (KNN) as a simple case study, which we implement with a distributed programming library prototyped to exploit topology awareness.We demonstrate the solution's effectiveness on a commodity cluster with GPU-equipped nodes and illustrate how it will apply to next-generation disaggregated hardware.

Source: International Symposium on Memory Systems (MEMSYS)

DOI: 10.1145/3695794.3695811

Authors: Beatrice Branchini, Ian Di Dio Lavore, Vito Giovanni Castellana, Marco Santambrogio

Institutions: Politecnico di Milano, Pacific Northwest National Laboratory

Language: English

Topic: Parallel Computing and Optimization Techniques

Subfield: Hardware and Architecture

Field: Computer Science

Domain: Physical Sciences

Open Access status: bronze

Funders: Office of the Director of National Intelligence, Intelligence Advanced Research Projects Activity

Award: G3625884985