Work

Comparative Analysis of Linear and Gradient Boosting Models for Log-Based Failure Prediction

Year: 2026
Type: article
Abstract: Modern distributed computing systems generate large volumes of system logs that capture detailed information about operational states and failure events. Leveraging these logs for proactive failure prediction is essential for improving system reliability and minimising downtime. This paper presents a comparative analysis of a linear classification model and a gradient boosting model for log-based server failure prediction. Logistic Regression is employed as an interpretable baseline model, while the Light Gradient Boosting Machine (LightGBM) is used to model complex, non-linear failure patterns. Experiments are conducted on two publicly available system log datasets—Hadoop Distributed File System (HDFS) logs and Blue Gene/L (BGL) logs, and evaluated under severe class imbalance using precision-recall–oriented performance metrics. The results show that LightGBM significantly outperforms Logistic Regression across all evaluation metrics, achieving a precision of 0.91, recall of 0.93, F1-score of 0.92, ROC-AUC of 0.95, and PR-AUC of 0.88, compared to Logistic Regression’s precision of 0.81, recall of 0.78, F1-score of 0.79, ROC-AUC of 0.85, and PR-AUC of 0.70. The substantial improvement in recall and PR-AUC indicates that LightGBM is more effective at identifying rare failure events, which is critical in imbalanced log-based prediction tasks. However, Logistic Regression provides greater model transparency and interpretability, which can be advantageous for operational trust and decision-making. Overall, this study demonstrates a clear trade-off between predictive performance and interpretability in log-based failure prediction. The findings suggest that gradient boosting models are better suited for high-accuracy failure detection in large-scale systems, while linear models remain valuable when explainability is a primary requirement. These insights support informed model selection for proactive failure management in distributed computing environments.
Language: English
Open Access status: bronze
OpenAlex ID: W7235784019
FWCI:
Cites: 8
Cited by:
Related to: 10