An adaptive placement framework for efficient near-data stream processing over data source-edge-cloud systems
Year: 2022
Type: dissertation
Abstract: Large amounts of data are being generated across many different domains including datacenters, surveillance cameras, mobile devices and other Internet-of-things (IoT) systems.This data is generated as streams, i.e., an unbounded sequence of data items which needs to be processed in near real-time.Large-scale datacenters report generating up to 10s of PBs of monitoring data per day from hundreds of thousands of server nodes.High bandwidth video data at rates of 1.4 TB/hr or more, will be generated from autonomous vehicles and other IoT systems.Processing this data is challenging due to limited network and compute resources in the cloud.Utilizing compute resources closer to the data source helps reduce network transfer costs and alleviates the compute load on cloud nodes.However, near-data compute resources are limited.E.g. data source nodes may have a small fraction of compute resources (e.g., 1-2 CPU cores) for near-data processing compared to cloud servers.Analytics applications which process streaming data are also becoming complex and increasingly resource-intensive.Thus, all the analytics processing cannot be done on nodes near the data source, while using remote resources incurs network transfer costs.To alleviate the resulting compute-communication bottlenecks, applications are partitioned to reduce network transfer costs, by making placement decisions to split the execution of its operations between cloud and near-data resource nodes.Resource conditions are frequently changing in such systems, thus requiring the placement decisions to also adapt.As an example, monitoring queries on server nodes (i.e., data sources in monitoring pipelines) are co-located with foreground applications such as web services which have different compute resource needs based on incoming traffic requests.Thus, resources available to the monitoring queries change over time.Furthermore, compute resource needs of applications on edge and cloud nodes are also affected by changing input rates.E.g., surveillance camera applications consist of dynamic camera networks, with cameras being added or removed from the network to handle tasks such as object detection and target tracking.In this dissertation, we argue for the need to make highly efficient placement decisions to meet the application resource demands under fast changing resource conditions.Existing systems place application components between near-data resources and cloud nodes, with the goal to better utilize the available compute resources and improve application performance.However, they do not scale well to efficiently handle the increasing number of application operations/resource nodes in modern stream processing systems.Furthermore, placement techniques which optimize application power consumption on battery-driven data source
Author: Sandur, Atul
Language: English
Subfield: Information Systems
Field: Computer Science
Domain: Physical Sciences
Open Access status: green
OpenAlex ID: W7220748554
