Improved Machine Learning-Based Intrusion Detection Systems for Secure Network Virtualization
Year: 2025
Type: dissertation
Abstract: The adoption of network virtualization and cloud computing has introduced new complexities and attack vectors, which demands more intelligent and scalable security solutions. In such cases, traditional Intrusion Detection Systems (IDS) often have struggle to provide effective protection. This research addresses this challenge by designing and developing an improved machine learning-based IDS with security for network virtualization in mind. The project is motivated by the need for security to be integrated into the system that not only attains high accuracy in detection but also provides good operational management and scalability under a cloud environment. Following through a quantitative experimental study the research laid the foundation on the CIC-IDS2017 dataset for training and evaluation on a battery of machine learning models that include Random Forest, Multi-Layer Perceptron (MLP), and Long Short-Term Memory (LSTM) networks. After a series of solid preprocessing, feature engineering, and hyperparameter tuning procedures, the Tuned Random Forest model emerged as a winner, attaining an accuracy of 98.47% and a strong weighted F1-score of 0.98 as per this research study. A core contribution of this work is an implementation of an end-to-end real-time IDS system that incorporates this highly accurate model and integrates it into one of the AWS cloud architectures. The system uses AWS Lambda for scalable, serverless inference; Amazon CloudWatch for rich monitoring with custom metrics and automated alarms; and Amazon Security Lake for standardized long-term event logging in the OCSF-open cybersecurity schema framework format. Real-time visualization and administrative control of the complete system are done through a web dashboard based on Flask. The evaluation establishes the efficacy of the ML model and the successful integration of the cloud components, establishing a scalable, manageable, and highly visible security solution apposite for modern virtualized networks.
Source: NORMA
Author: Biju, Albin
Institution: National College of Ireland
Language: English
Subfield: Computer Networks and Communications
Field: Computer Science
Domain: Physical Sciences
Open Access status: green
OpenAlex ID: W7140068874