Work

CERL: Evolutionary Reinforcement Learning for Partitioned Collaborative Inference on On-Device Models

Year: 2025

Type: article

Abstract: The rapid expansion of intelligent mobile applications has made the deployment of Deep Neural Networks (DNNs) on Mobile Edge Devices (EDs) a critical necessity. However, the inherent computational limitations of EDs frequently result in severe energy inefficiency and compromised inference precision. To overcome these hurdles, we present a Distributed Collaborative Inference (DCI) framework aimed at minimizing on-device overhead by dispersing inference burdens across a mesh of EDs and Mobile Edge Computing (MEC) nodes. To effectively navigate the system's dynamic complexities, we construct an evolutionary reinforcement learning algorithm anchored in the Cross-Entropy Method (CEM). A novel feature of this algorithm is the utilization of negative Temporal Difference (TD) error as a fitness criterion for isolating elite population members. By leveraging high-fidelity samples from these elites, the learning trajectory is expedited, facilitating optimal decision-making in volatile environments. Simulation outcomes demonstrate the superiority of our method over current standards, evidencing a 57.5% rise in task completion rates and a 65.7% decrease in aggregate system costs.

Source: Journal of Machine Learning and Information Security

DOI: 10.53941/jmlis.2025.100005

Authors: Lin Tan, Songtao Guo, Pengzhan Zhou, Zhufang Kuang

Institutions: Chongqing University, Central South University of Forestry and Technology

Language: English

Topic: IoT and Edge/Fog Computing

Subfield: Computer Networks and Communications

Field: Computer Science

Domain: Physical Sciences

SDG: Industry, innovation and infrastructure

Open Access status: hybrid

Funders: National Natural Science Foundation of China, Centre Scientifique et Technique du Bâtiment, Fundamental Research Funds for the Central Universities