Runtime Optimizations for Large-Scale Data Analytics
Year: 2018
Type: dissertation
Abstract: Large-scale data analytics is key to modern science, technology, and business development.Big data systems have emerged rapidly in recent years, but modern data analytics remains challenging due to application requirements.First, users need to analyze vasts amount of data generated from various sources; Second, analysis efficiency is critical in many scenarios; Third, most big data systems are built on top of new operating environments, such as clusters and cloud services, where resource management is important; Fourth, high-level, feature-rich programming interfaces are required to support a high variety of data and workload types.In this dissertation, we present methods to improve system efficiency for large-scale data analytics.We investigate the problem in the context of three research projects, which address the same key problem: optimization of analytical query execution, in different ways.Specifically, these projects focus on runtime optimzation, which considers not only static information that is available prior to the actual execution, but more importantly, runtime information.We demonstrate, from these projects, that runtime optimzation can significantly improve overall system performance: it can lower query execution times, improve resource utilization, and reduce application failures.We first present a full-stack solution for recursive relational query evaluation in shared-nothing engines.Users express their analysis using a high-level declarative language (a subset of Datalog with aggregate functions).Queries are then compiled into distributed query plans with termination guarantee.Multiple execution models for iterative queries are supported, including synchronous, asynchronous, and different processing priorities.Our evaluation shows that application properties determine which model yields the fastest query execution time.Next, we present ElasticMem, an approach for automatic and elastic memory management for cloud data analytics applications.In clouds or clusters, a resource manager schedules applications in containers with hard memory limits, which requires accurate application memory usage estimation before launching containers.However, memory estimation for large-scale analytical applications is difficult, and inappropriate estimate can lead to failures and performance degredation.ElasticMem avoids pre-execution memory usage estimation by elastically allocating memory across containers during runtime.Experiments show that ElasticMem outperforms static memory allocation, leading to fewer query failures, lower garbage collection overheads, and lower query times.Lastly, we present Deluceva, a system that dynamically optimizes neural network inference for video analytics.Many video analysis approaches apply neural network models trained on images directly to each video frame.While being easy to develop, these approaches do not leverage the rich temporal redundancy in videos, which can be used to further reduce model inference time.Deluceva accelerates model inference by dynamically selecting sufficiently significant temporal deltas to process for each video frame.Evaluation on three models and six videos shows that it can achieve significant performance gains with low errors.First, I would like to express my sincerest gratitude to my advisor Magdalena Balazinska.The way that she interacts with students and collaborators, her attitude and standards of academic research, and more generally, her wisdom on career and life, have set up great examples for me to observe, think, learn, and execute during these years.I am especially grateful to be consistently impacted by her perfectly balanced advising style: strict but also tolerant, optimistic but a believer of Murphy's law, patient but pushes when needed, leaving students space to grow but also providing detailed, reliable, hands-on mentoring.I hope that I have picked up these characteristics to some extent and hopefully will have the chance to apply them one day.In addition to Magda, I would like to also thank my other "unofficial" advisors.I want to thank Dan Suciu for his thorough and deep understanding and extremely solid support on any problem relevant to theory.I would also like to thank Bill Howe and Alvin Cheung for bringing their perspectives and expertise from other sub-areas, and Arvind Krishnamurthy and Bingni Burton for being my committee members.During my internships
Author: Jingjing Wang
Language: English
Subfield: Information Systems
Field: Computer Science
Domain: Physical Sciences
Open Access status: green
OpenAlex ID: W2946360836
