Work

Neural Network-Based Bandit: A Medium Access Control for the IIoT Alarm Scenario

Year: 2024

Type: article

Abstract: Efficient Random Access (RA) is critical for enabling reliable communication in Industrial Internet of Things (IIoT) networks. Herein, we propose a deep reinforcement learning-based distributed RA scheme, entitled Neural Network-Based Bandit (NNBB), for the IIoT alarm scenario. In such a scenario, devices may detect a common critical event, and the goal is to ensure the alarm information is delivered successfully from at least one device. The proposed NNBB scheme is implemented at each device, where it trains itself online and establishes implicit inter-device coordination to achieve the common goal. We devise a procedure for acquiring a valuable context for NNBB, which then uses a deep neural network to process this context and let devices determine their action. Each possible transmission pattern, i.e., transmit channel(s) allocation, constitutes a feasible action. Our simulation results show that as the number of devices in the network increases, so does the performance gain of the NNBB compared to the Multi-Armed Bandit (MAB) RA benchmark. For instance, NNBB experiences a 7% success rate drop when there are four channels and the number of devices increases from 10 to 60, while MAB faces a 25% drop.

Source: IEEE Open Journal of the Communications Society

DOI: 10.1109/ojcoms.2024.3506033

Authors: Prasoon Raghuwanshi, Onel Luis Alcaraz López, Neelesh B. Mehta, Hirley Alves, Matti Latva-Aho

Institutions: University of Oulu, Indian Institute of Science Bangalore

Language: English

Topic: IoT Networks and Protocols

Subfield: Electrical and Electronic Engineering

Field: Engineering

Domain: Physical Sciences

SDG: Industry, innovation and infrastructure

Open Access status: gold

Estimated APC paid: $1,995