Over-the-Air Machine Learning at the Wireless Edge
Year: 2019
Type: conference-paper
Abstract: We study distributed machine learning at the wireless edge, where limited power devices (workers) with local datasets implement distributed stochastic gradient descent (DSGD) over-the-air with the help of a remote parameter server (PS). We consider a bandwidth-limited fading multiple access channel (MAC) from the workers to the PS for communicating the local gradient estimates. Motivated by the additive nature of the wireless MAC, we study analog transmission of low-dimensional gradient estimates while accumulating error from previous iterations. We also design an opportunistic worker scheduling scheme to align the received gradient vectors at the PS in an efficient manner. Numerical results show that the proposed DSGD algorithm converges much faster than the state-of-the-art, while also providing a significantly higher accuracy.
Authors: Mohammad Mohammadi Amiri, Deniz Gündüz
Institution: Imperial College London
Language: English
Topic: IoT and Edge/Fog Computing
Subfield: Computer Networks and Communications
Field: Computer Science
Domain: Physical Sciences
Open Access status: green
OpenAlex ID: W2971330699
