Hyperparameter Impact on Learning Efficiency in Q-learning and Dqn Using Openai Gymnasium Environments
Year: 2025
Type: article
Abstract: This study compares the Q-learning and DQN methodologies within the CartPole-v1 environment. All methods were executed, trained, and evaluated according to test outcomes and training improvements. The research paper includes statistical summaries, and visualizations of performance and learning. This paper examines the impact of hyperparameters on the learning efficiency of Q-Learning and Deep Q-Network (DQN) in the CartPole-v1 environment of OpenAI Gymnasium. The results indicate that DQN substantially outperforms Q-Learning. DQN achieved a peak training reward of 500, whereas Q-Learning maintained an average test reward of 23. The hyperparameters that enhance DQN\'s neural network and performance include a learning rate of 0.001 and a batch size of 64. The efficacy of Q-Learning was hindered by inadequate hyperparameters and imprecise state discretization. The findings underscore the necessity of hyperparameter tuning to enhance the efficiency of reinforcement learning.
Authors: Ali Raza, Asfand Ali, Alaptageen Qayyum, Ghulam Shabir, Zahid Hussain, Ghulam Murtaza
Language: English
Subfield: Artificial Intelligence
Field: Computer Science
Domain: Physical Sciences
Open Access status: hybrid
OpenAlex ID: W4411395998