Cooperative Formation Control of a Multi-Agent Khepera IV Mobile Robots System Using Deep Reinforcement Learning
Year: 2025
Type: article
Abstract: The increasing complexity of autonomous vehicles has exposed the limitations of many existing control systems. Reinforcement learning (RL) is emerging as a promising solution to these challenges, enabling agents to learn and enhance their performance through interaction with the environment. Unlike traditional control algorithms, RL facilitates autonomous learning via a recursive process that can be fully simulated, thereby preventing potential damage to the actual robot. This paper presents the design and development of an RL-based algorithm for controlling the collaborative formation of a multi-agent Khepera IV mobile robot system as it navigates toward a target while avoiding obstacles in the environment by using onboard infrared sensors. This study evaluates the proposed RL approach against traditional control laws within a simulated environment using the CoppeliaSim simulator. The results show that the performance of the RL algorithm gives a sharper control law concerning traditional approaches without the requirement to adjust the control parameters manually.
Source: Applied Sciences
DOI: 10.3390/app15041777
Authors: Gonzalo Garcia(Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Software, Writing – original draft), Azim Eskandarian(Project administration, Supervision), Ernesto Fabregas(Funding acquisition, Validation, Writing – original draft, Writing – review & editing), Hector Vargas(Project administration, Resources, Supervision, Validation, Writing – review & editing), Gonzalo Farias(Conceptualization, Funding acquisition, Project administration, Resources, Validation, Writing – original draft, Writing – review & editing)
Language: English
Subfield: Artificial Intelligence
Field: Computer Science
Domain: Physical Sciences
Open Access status: gold
Estimated APC paid: $2,896
Awards: G139207594, G5795394854, G5915948809
OpenAlex ID: W4407296262
