Communication-Efficient Model Aggregation With Layer Divergence Feedback in Federated Learning
Year: 2024
Type: article
Abstract: Federated Learning (FL) facilitates collaborative machine learning by training models on local datasets, and subsequently aggregating these local models at a central server. However, the frequent exchange of model parameters between clients and the central server can result in significant communication overhead during the FL training process. To solve this problem, this letter proposes a novel FL framework, the Model Aggregation with Layer Divergence Feedback mechanism (FedLDF). Specifically, we calculate model divergence between the local model and the global model from the previous round. Then through model layer divergence feedback, the distinct layers of each client are uploaded and the amount of data transferred is reduced effectively. Moreover, the theoretical analysis reveals that the access ratio of clients has a positive correlation with model performance. Simulation results show that our algorithm uploads local models with reduced communication overhead while upholding a superior global model performance.
Source: IEEE Communications Letters
Authors: Liwei Wang, Jun Li, Wen Chen, Qingqing Wu, Ming Ding
Institutions: Shanghai Jiao Tong University, Southeast University, Data61
Language: English
Subfield: Artificial Intelligence
Field: Computer Science
Domain: Physical Sciences
Open Access status: green
OpenAlex ID: W4402288769