Year: 2017
Type: conference-paper
Abstract: Processing a one trillion-edge graph has recently been demonstrated by distributed graph engines running on clusters of tens to hundreds of nodes. In this paper, we employ a single heterogeneous machine with fast storage media (e.g., NVMe SSD) and massively parallel coprocessors (e.g., Xeon Phi) to reach similar dimensions. By fully exploiting the heterogeneous devices, we design a new graph processing engine, named Mosaic, for a single machine. We propose a new locality-optimizing, space-efficient graph representation---Hilbert-ordered tiles, and a hybrid execution model that enables vertex-centric operations in fast host processors and edge-centric operations in massively parallel coprocessors. Our evaluation shows that for smaller graphs, Mosaic consistently outperforms other state-of-the-art out-of-core engines by 3.2-58.6x and shows comparable performance to distributed graph engines. Furthermore, Mosaic can complete one iteration of the Pagerank algorithm on a trillion-edge graph in 21 minutes, outperforming a distributed disk-based engine by 9.2×.
Institution: Georgia Institute of Technology
Language: English
Topic: Graph Theory and Algorithms
Subfield: Computational Theory and Mathematics
Field: Computer Science
Domain: Physical Sciences
Open Access status: bronze
Funders: National Science Foundation, Ministry of Science, ICT and Future Planning, Electronics and Telecommunications Research Institute, Defense Advanced Research Projects Agency, Science and Engineering Research Board, Institute for Information and Communications Technology Promotion, Office of Naval Research
Awards: SaTC-EDU: EAGER: Big Data and Security: Educating the Next-Generation Security Analysts, G1761741488, G3337934819, G3371991119, G3451778092, CI-P: Collaborative: Planning for a Community-Driven Open Research Infrastructure to Support Secure Computing Research involving Intel SGX, G6486092784, TWC: Medium: Collaborative: Systems, Tools, and Techniques for Executing, Managing, and Securing SGX Programs
OpenAlex ID: W2606413522
