Work

A Routing and Cache Management Framework Based on Adaptive Q-Learning for Marine Opportunistic Networks

Year: 2026

Type: article

Abstract: Marine opportunistic networks are characterized by highly dynamic topology, intermittent connectivity, and severe resource constraints. Traditional routing protocols that rely on fixed-parameter Q-learning cannot adapt to real-time network changes, leading to suboptimal performance. This paper proposes an adaptive framework with three novel contributions: (1) a dynamic learning rate that adapts to network scale, node load, and congestion; (2) a dynamic discount factor that adjusts according to message urgency, hop count, and node mobility; (3) a multi-dimensional reward function with sliding window weights to balance delay, hop count, and node reliability. An asynchronous double Q-learning structure further mitigates overestimation bias. Extensive simulations on the ONE platform demonstrate that the proposed integrated algorithm (IR-DQ) achieves a high delivery ratio, significantly outperforming Epidemic and Spray and Wait, while substantially reducing overhead compared to fixed-parameter Q-learning. The framework exhibits superior adaptability to dynamic marine environments.

Source: Electronics

DOI: 10.3390/electronics15102056

Authors: Zerun Wang, Shengming Jiang

Institution: Shanghai Maritime University

Language: English

Topic: Opportunistic and Delay-Tolerant Networks

Subfield: Computer Networks and Communications

Field: Computer Science

Domain: Physical Sciences

SDG: Industry, innovation and infrastructure

Open Access status: gold

Estimated APC paid: $2,896