Work

A Hybrid Pure Pursuit–PID and TD3 Control Framework for Differential-Drive Mobile Robots

Year: 2026
Type: article
Abstract: In this study, a hybrid control structure that combines classical control methods with reinforcement learning is proposed for target tracking of a differential-drive mobile robot. In the proposed framework, Pure Pursuit–based reference generation and an inner-loop Proportional–Integral–Derivative (PID) controller are integrated with the Twin Delayed Deep Deterministic Policy Gradient (TD3) algorithm. While the classical Pure Pursuit–PID structure ensures baseline stability and safety, the TD3-based learning component enhances performance by generating corrective torque contributions when classical control becomes insufficient. First, experiments are conducted under nominal system conditions to demonstrate that the proposed approach preserves the fundamental behavior of the classical controller and achieves comparable trajectory-tracking performance. Subsequently, the robustness of the control schemes is evaluated under parametric uncertainties applied to the chassis and wheel masses. Experimental results show that the classical PID-based control structure fails to achieve stable convergence under these uncertainties, whereas the proposed reinforcement learning–enhanced controller consistently reaches the target in a stable and reliable manner across all tested scenarios, achieving a 100% success rate. Quantitative analysis further indicates that the proposed method significantly improves convergence behavior and tracking stability by reducing trajectory deviations and eliminating oscillatory behavior observed in the classical controller. Furthermore, the influence of key learning components—such as minibatch size, replay buffer capacity, optimization algorithm, and network architecture—on control performance is systematically analyzed through a comprehensive ablation study. The results demonstrate that the proposed residual learning approach provides superior stability and robustness, effectively overcoming the practical limitations of classical control methods. Accordingly, this study presents a reliable and generalizable mobile robot control architecture capable of coping with model uncertainties and dynamic variations that are inevitable in real-world applications.
Source: IEEE Access
Language: English
Open Access status: gold
Estimated APC paid: $2,075
OpenAlex ID: W7160621918
FWCI: 0.931
Cites: 36
Cited by: 1
Related to: 10