CB-DSL: Communication-Efficient and Byzantine-Robust Distributed Swarm Learning on Non-i.i.d. Data
Year: 2023
Type: article
Abstract: The valuable data collected by IoT devices together with the resurgence of machine learning (ML) stimulate the latest trend of artificial intelligence (AI) at the edge. However, traditional ML and recent federated learning (FL) face major challenges including communication bottleneck, data heterogeneity, and security concerns in edge IoT. Meanwhile, the swarm nature of IoT systems is overlooked by most existing literature, which calls for new designs of distributed learning algorithms. Inspired by the success of biological intelligence (BI) of gregarious organisms, we propose a novel edge learning approach for swarm IoT, called communication-efficient and Byzantine-robust distributed swarm learning (CB-DSL), through a holistic integration of AI-enabled stochastic gradient descent and BI-enabled particle swarm optimization. To deal with the non-i.i.d. data issues and Byzantine attacks, a small amount of global data samples are introduced in CB-DSL and shared among IoT workers, which alleviates the local data heterogeneity effectively and enables to fully utilize the exploration-exploitation mechanism of swarm intelligence. Our convergence analysis theoretically demonstrates that the CB-DSL is superior to the standard FL with better convergence behavior. We also evaluate the model divergence of CB-DSL by deriving its upper bound, which measures the effectiveness of the introduction of the globally shared dataset.
Language: English
Subfield: Artificial Intelligence
Field: Computer Science
Domain: Physical Sciences
Open Access status: green
Awards: CCSS: Distributed Swarm Learning for Internet of Things at the Edge, 面向下一代无线网络的多维度物理层安全绿色通信系统研究, CIF: Small: Signal Processing and Learning for NOMA Millimeter-Wave Massive MIMO Systems, 面向未来移动通信的低功耗安全智慧物联网系统关键技术研究, CIF: Small: Communication-efficient and robust learning from distributed data, G7811672881, Collaborative Research: SWIFT: Intelligent Dynamic Spectrum Access (IDEA): An Efficient Learning Approach to Enhancing Spectrum Utilization and Coexistence, G8873990007, MLWiNS: Decentralized Heterogeneous Deep Learning for Efficient Wireless Spectrum Monitoring
OpenAlex ID: W4386469847
