Work

Accelerating Large-Scale Data Analysis by Offloading to High-Performance Computing Libraries using Alchemist

Year: 2018
Type: conference-paper
Abstract: Apache Spark is a popular system aimed at the analysis of large data sets, but recent studies have shown that certain computations---in particular, many linear algebra computations that are the basis for solving common machine learning problems---are significantly slower in Spark than when done using libraries written in a high-performance computing framework such as the Message-Passing Interface (MPI).
Authors: Alex Gittens, Kai Rothauge, Shusen Wang, Michael W. Mahoney, Lisa Gerhardt, Prabhat, Jey Kottalam, Michael Ringenburg, Kristyn Maschhoff
Language: English
Open Access status: bronze
OpenAlex ID: W2807629360
FWCI: 1.505
Cites: 21
Cited by: 16
Related to: 10