MPI-ACC: An Integrated and Extensible Approach to Data Movement in Accelerator-based Systems
Year: 2012
Type: conference-paper
Abstract: Data movement in high-performance computing systems accelerated by graphics processing units (GPUs) remains a challenging problem. Data communication in popular parallel programming models, such as the Message Passing Interface (MPI), is currently limited to the data stored in the CPU memory space. Auxiliary memory systems, such as GPU memory, are not integrated into such data movement frameworks, thus providing applications with no direct mechanism to perform end-to-end data movement. We introduce MPI-ACC, an integrated and extensible framework that allows end-to-end data movement in accelerator-based systems. MPI-ACC provides productivity and performance benefits by integrating support for auxiliary memory spaces into MPI. MPI-ACC's runtime system enables several key optimizations, including pipelining of data transfers and balancing of communication based on accelerator and node architecture. We demonstrate the extensible design of MPIACC by using the popular CUDA and OpenCL accelerator programming interfaces. We examine the impact of MPI-ACC on communication performance and evaluate application-level benefits on a large-scale epidemiology simulation.
DOI: 10.1109/hpcc.2012.92
Institutions: Virginia Tech, Argonne National Laboratory
Language: English
Subfield: Hardware and Architecture
Field: Computer Science
Domain: Physical Sciences
Open Access status: hybrid
Awards: G102163711, I/UCRC Proposal For University Site At Virginia Tech: Center For High-Performance Reconfigurable Computing (CHREC), G1637977357, MRI-R2: Acquisition of a Heterogeneous Supercomputing Instrument for Transformative Interdisciplinary Research, G262962599, G4950536974, Synthetic Information Systems for Better Informing Public Health Policymakers, Collaborative Research: Coupled Models of Diffusion and Individual Behavior Over Extremely Large Social Networks, G6541015203, G6848031779, CSR: Small: Collaborative Research: Hybrid Opportunistic Computing for Green Clouds, G969889393
OpenAlex ID: W2012173227
