Work

Locality Optimizations for Regular and Irregular Applications

Year: 2016
Type: article
Abstract: The fastest supercomputer in the world as of July 2016 is the Sunway TaihuLight.It can achieve a staggering performance of 93 PetaFlops.This incredible performance is achieved via massive parallelism.Today's supercomputers and compute clusters have tens of thousands of distributed memory nodes with each node comprised of several shared memory multi/many core processors.Scaling on these massively parallel systems is not an easy task.A major performance and scalability bottleneck is the limited data movement bandwidth, which can be orders of magnitude smaller than the computation bandwidth.Developing applications to scale on these massively parallel systems requires minimizing data movement volume at different levels of memory hierarchy using locality optimization techniques.Locality optimization aims to reduce the data movement between slow and fast memory by rescheduling/remapping the original computation to reuse the data once it is in fast memory, thereby avoiding subsequent movement of the same data from slow memory.This dissertation explores multiple aspects of locality optimizations for enhancing scalability and performance of various regular and irregular applications on massively parallel computing environment.It develops distributed algorithms, lower bound techniques, and compiler and runtime frameworks for optimizing Tensor Contractions, Four-Index Transform, Convolutional Neural Networks (CNNs), and Recursive Tree Pursuing the doctoral degree has been an intellectual and a spiritual journey for me.I am grateful to many people for their love, support, and guidance, without which I would be lost.First and foremost, I would like to express my earnest gratitude towards my advisor Dr. P. Sadayappan.His compassion knows no bounds.In the early years of my Ph.D. I was struggling to recover from tendonitis on my wrists which made it difficult for me to use my hands.It was his patience and encouragement at this time that allowed me to continue.Since then, he has been a constant source of guidance and inspiration.I will forever be indebted to him for all he has taught me.In addition to my advisor, I have had the privilege to work with many great minds in the last five years.
Language: English
Open Access status: green
OpenAlex ID: W2600389602
FWCI:
Cites: 110
Cited by:
Related to: 10