Work

Research on Obstacle Avoidance Scenario Design for Unmanned Surface Vehicle Based on Q-Learning

Year: 2026
Type: article
Abstract: _ Regarding the design of test scenarios for evaluating the performance of obstacle avoidance algorithms in unmanned surface vehicles (USVs), this article proposes a test scenario constructing method based on Q-learning algorithm. Considering the radius and layout position of obstacles, with the constraints that obstacles are placed within the boundaries of the test scenario and no overlap exists between obstacles, setting the cost of the obstacle avoidance path as the evaluation target, the placement state of obstacles and the translation update action are designed. A minimum distance translation method is employed to handle design schemes that violate the placement constraints during the iteration process. Through testing and comparison with obstacle avoidance algorithms of typical A* and ant colony optimization, as well as the obstacle layout algorithm of genetic optimization, the results demonstrate that the obstacle layout scheme constructed by the Q-learning algorithm achieves superior performance. Compared with manually designed scenarios, the path costs of the two obstacle avoidance algorithms are increased by 15.8% and 17.3%, respectively, effectively testing the path search complexity of the obstacle avoidance algorithms and providing a reference for the automatic construction of USV obstacle avoidance test scenarios. Keywords test scenario design; unmanned surface vehicle; obstacle avoidance; Q-learning
Language: English
Open Access status: bronze
OpenAlex ID: W7236572729
FWCI:
Cites: 30
Cited by:
Related to: 10