Work

LLM-guided deep reinforcement learning with contrastive safety regularization for autonomous driving

Year: 2026
Type: article
Abstract: Deep Reinforcement Learning has shown immense potential in autonomous driving decision-making; however, its application in safety–critical scenarios such as highways still faces significant challenges in data efficiency and safety performance. To address this, this paper proposes an LLM-guided Safety-Aware DQN (LSA-DQN) framework. This framework first utilizes a multi-head attention network to enhance the comprehension of complex traffic scenarios. Building on this, we design a method combining physics-based pre-screening and Large Language Model (LLM) arbitration to accurately classify experience data. Furthermore, we devise a hybrid safety regularization method that integrates Conservative Q-Learning with a Margin-based Contrastive Penalization (MCP) to learn explicit safety boundaries. Experimental results demonstrate that, compared to baseline algorithms, LSA-DQN reduces the collision rate to 0.9% while maintaining high traffic efficiency, proving its high robustness and reliability in complex and dynamic highway environments.
Authors: Haochen Ren, Yuelin Xing
Institution: Shandong University
Language: English
Open Access status: gold
Estimated APC paid: $1,590
OpenAlex ID: W7126159785
FWCI: 5.785
Cites: 21
Cited by: 3
Related to: