Exploring the Limits of Deep Learning: A Study on Overfitting and Regularization Techniques
Year: 2023
Type: article
Abstract: This paper aims to investigate the limits of deep learning by exploring the issue of overfitting in deep neural networks and the various regularization techniques used to mitigate it. Overfitting in deep learning occurs when a model is too complex and learns the training data too well, resulting in poor generalization performance on unseen data. To address this issue, regularization techniques such as L1 and L2 regularization, dropout, and early stopping are discussed and compared. The effectiveness of each technique is evaluated through experiments on standard benchmark datasets. Additionally, the use of ensemble methods for deep learning regularization is explored. The results of this study provide insights into the limitations of deep learning and the various approaches that can be used to improve its generalization performance.
Author: Mungoli, Neelesh
Institution: University of North Carolina at Charlotte
Language: English
Subfield: Artificial Intelligence
Field: Computer Science
Domain: Physical Sciences
Open Access status: green
OpenAlex ID: W4382338587
