Skip to main content

Convergence of Federated Learning Over a Noisy Downlink

Author(s): Amiri, Mohammad Mohammadi; Gunduz, Deniz; Kulkarni, Sanjeev R; Poor, H Vincent

To refer to this page use:
Abstract: We study federated learning (FL), where power-limited wireless devices utilize their local datasets to collaboratively train a global model with the help of a remote parameter server (PS). The PS has access to the global model and shares it with the devices for local training using their datasets, and the devices return the result of their local updates to the PS to update the global model. The algorithm continues until the convergence of the global model. This framework requires downlink transmission from the PS to the devices and uplink transmission from the devices to the PS. The goal of this study is to investigate the impact of the bandwidth-limited shared wireless medium on the performance of FL with a focus on the downlink. To this end, the downlink and uplink channels are modeled as fading broadcast and multiple access channels, respectively, both with limited bandwidth. For downlink transmission, we first introduce a digital approach, where a quantization technique is employed at the PS followed by a capacity-achieving channel code to transmit the global model update over the wireless broadcast channel at a common rate such that all the devices can decode it. Next, we propose analog downlink transmission, where the global model is broadcast by the PS in an uncoded manner. We consider analog transmission over the uplink in both cases, since its superiority over digital transmission for uplink has been well studied in the literature. We further analyze the convergence behavior of the proposed analog transmission approach over the downlink assuming that the uplink transmission is error-free. Numerical experiments show that the analog downlink approach provides significant improvement over the digital one with a more notable improvement when the data distribution across the devices is not independent and identically distributed. The experimental results corroborate the convergence analysis, and show that a smaller number of local iterations should be used when the data distribution is more biased, and also when the devices have a better estimate of the global model in the analog downlink approach.
Publication Date: 17-Aug-2021
Citation: Amiri, Mohammad Mohammadi, Gunduz, Deniz, Kulkarni, Sanjeev R, Poor, H Vincent. (2022). Convergence of Federated Learning Over a Noisy Downlink. IEEE Transactions on Wireless Communications, 21 (3), 1422 - 1437. doi:10.1109/twc.2021.3103874
DOI: doi:10.1109/twc.2021.3103874
ISSN: 1536-1276
EISSN: 1558-2248
Pages: 1422 - 1437
Type of Material: Journal Article
Journal/Proceeding Title: IEEE Transactions on Wireless Communications
Version: Author's manuscript

Items in OAR@Princeton are protected by copyright, with all rights reserved, unless otherwise indicated.