Work

Autonomous Service Management in the Cloud

Year: 2023
Type: dissertation
Abstract: Applications and services have become more complex, while the Internet has become increasingly difficult to evolve both regarding its physical infrastructure, and its protocols and performance.Being responsible for policy configurations as well as network management and performance tuning, network operators are shifting towards the use of more and more automated tools to accomplish these tasks.The concept of "programmable networks" has emerged to alleviate the challenges, and to facilitate network evolution.This includes paradigms such as (i) software-defined networking (SDN) and (ii) network function virtualization (NFV), which decouple the forwarding hardware into control plane and data plane, and which seek to abstract network forwarding, and other networking functions, from the hardware.In the era of "big data" on cloud computing, these paradigms have enabled rich network traffic processing services, while having also reduced the granularity of task allocation in data centres.It has been recognised that shifting controllers from logically-centralised to distributed will increase not only scalability, but also robustness to inconsistency.Machine-Learning (ML)-based approaches have been proposed to deploy more intelligence in networks, when using decoupled control and data planes.In this context, the question explored in this thesis is whether, and how, it is possible to offer generic, data-driven networking functions in data center networks as services, for constructing autonomous networking systems which optimize networking performances with minimal human intervention and operational complexity.This thesis investigate the increasing scale, complexity, and heterogeneity of networking infrastructure, and of protocols, as well as the demand for virtualisation and cloud support services in terms of efficient resource management, rapid provisioning and scalability presents a set of new challenges in effective network organisation, management and optimisation.This is accomplished by studying how certain network functions and primitives (traffic classification, auto-scaling, load balancing) can be reliably enhanced by various data-driven algorithms, while bearing in mind the in-production requirements in data center networks -- high scalability, high throughput, low latency, and low overheads.The characteristics of networking features in the context of in-production overlay networks are investigated first, which opens the discussion of the challenges of collecting measurement and deploying data-driven networking policies in real-world systems.To tackle these challenges, a generic tool to extract networking features from the data plane and deploy ML algorithms for various networking functions in real-world networking systems is built.A methodological framework is also designed and showcased, allowing for developing algorithms of different learning paradigms for networking problems.This thesis then dedicates the study on network load balancing problems in data center networks, on which a survey of state-of-the-art load balancers is provided.A hardware-based load balancing mechanism is proposed, achieving line-rate load-aware workload distribution by exploiting server load information embedded in packet headers as feedback signals.Finally, both an open-loop and a closed-loop learning load balancing algorithms are proposed based on learning algorithms, and they show better performance than state-of-the-art load balancing methods.
Source: HAL
Author: Yao, Zhiyuan
Language: English
Open Access status: green
OpenAlex ID: W4392220051
Cites: 26
Cited by:
Related to: 9