Year: 2024
Type: article
Abstract: Understanding the bias-variance tradeoff is pivotal for selecting optimal machine learning models. This paper empirically examines bias, variance, and mean squared error (MSE) across regression and classification datasets, using models ranging from decision tree to ensemble methods like random forest and gradient boost. Results show that ensemble methods such as Random Forest, Gradient Boosting and XGBoost consistently achieve the best tradeoff between bias and variance, resulting in the lowest overall error while simpler models such as Decision Tree and k-NN can have either high bias or high variance. This analysis bridges the gap between the theoretical bias-variance concepts and practical model selection, and offers in- sights into algorithm performance across diverse datasets. Insights from this work can guide practitioners in model selection, balancing predictive performance and interpretability.
Author: Hardev Ranglani
Language: English
Subfield: Artificial Intelligence
Field: Computer Science
Domain: Physical Sciences
Open Access status: diamond
OpenAlex ID: W4406462912