Work

Reinforcement learning and optimization methods in sensor networks

Year: 2025
Type: article
Abstract: Distributed Sensor Networks (DSNs) [1] are ubiquitous in civilian and military applications, with a wide range of uses including motion detection, healthcare, remote sensing, surveillance, and imaging.The deployment of DSNs involves various constraints on the sensor nodes and the network, such as i) bandwidth-limited communication ii) power consumption iii) response time of sensor nodes iv) compute limitations and many others.For instance, a DSN deployed in a battlefield must exhibit low power consumption and fast sensor response time to external stimuli within a bandwidth-limited communication network.In recent years, computing power has undergone significant advancements, largely propelled by improvements in System-on-Chip (SoC) technologies.These improvements have paved the way for the integration of Machine Learning (ML) capabilities into sensor nodes.Machine learning algorithms often leverage neural networks, which demand substantial memory, bandwidth, and computational resources.Consequently, this imposes heightened bandwidth and power requisites on DSNs to support ML implementation in sensor nodes.Thus, there arises a pressing need for innovative algorithms aimed at resource optimization within DSNs, a challenge that we address in this thesis.Resource optimization algorithms for DSNs vary based on their topology.In this thesis, we focus on DSNs characterized by a centralized structure, comprising a central controller/central node and numerous sensor nodes.Notably, the sensors can communicate only with the central node.Within the scope of this thesis, we refer to this topology as the central topology.Within central topology DSNs, we tackle two distinct problems; i) energy efficient model-free approach to tracking an object moving through a sensing grid ii) bandwidth-efficient methods for learning a machine learning model at the central controller using data gathered from the sensor nodes.We address the problem of energy efficient model-free tracking though the lens of RL (Reinforcement Learning) and the problem of bandwidth efficient learning through compressed distributed Stochastic Gradient Descent (SGD).He not only provided invaluable mentorship but also entrusted me with the intellectual freedom to explore unconventional problems in machine learning, which I truly appreciate.His unwavering patience, even when faced with my developing writing skills, was a constant source of encouragement.
Language: English
Open Access status: green
OpenAlex ID: W7220782844
FWCI:
Cites: 45
Cited by:
Related to: 10