Skip to main content

Convergence of Federated Learning Over a Noisy Downlink

Author(s): Amiri, Mohammad Mohammadi; Gunduz, Deniz; Kulkarni, Sanjeev R; Poor, H Vincent

Download
To refer to this page use: http://arks.princeton.edu/ark:/88435/pr1mg7fv9p
Full metadata record
DC FieldValueLanguage
dc.contributor.authorAmiri, Mohammad Mohammadi-
dc.contributor.authorGunduz, Deniz-
dc.contributor.authorKulkarni, Sanjeev R-
dc.contributor.authorPoor, H Vincent-
dc.date.accessioned2024-01-07T16:46:41Z-
dc.date.available2024-01-07T16:46:41Z-
dc.date.issued2021-08-17en_US
dc.identifier.citationAmiri, Mohammad Mohammadi, Gunduz, Deniz, Kulkarni, Sanjeev R, Poor, H Vincent. (2022). Convergence of Federated Learning Over a Noisy Downlink. IEEE Transactions on Wireless Communications, 21 (3), 1422 - 1437. doi:10.1109/twc.2021.3103874en_US
dc.identifier.issn1536-1276-
dc.identifier.urihttp://arks.princeton.edu/ark:/88435/pr1mg7fv9p-
dc.description.abstractWe study federated learning (FL), where power-limited wireless devices utilize their local datasets to collaboratively train a global model with the help of a remote parameter server (PS). The PS has access to the global model and shares it with the devices for local training using their datasets, and the devices return the result of their local updates to the PS to update the global model. The algorithm continues until the convergence of the global model. This framework requires downlink transmission from the PS to the devices and uplink transmission from the devices to the PS. The goal of this study is to investigate the impact of the bandwidth-limited shared wireless medium on the performance of FL with a focus on the downlink. To this end, the downlink and uplink channels are modeled as fading broadcast and multiple access channels, respectively, both with limited bandwidth. For downlink transmission, we first introduce a digital approach, where a quantization technique is employed at the PS followed by a capacity-achieving channel code to transmit the global model update over the wireless broadcast channel at a common rate such that all the devices can decode it. Next, we propose analog downlink transmission, where the global model is broadcast by the PS in an uncoded manner. We consider analog transmission over the uplink in both cases, since its superiority over digital transmission for uplink has been well studied in the literature. We further analyze the convergence behavior of the proposed analog transmission approach over the downlink assuming that the uplink transmission is error-free. Numerical experiments show that the analog downlink approach provides significant improvement over the digital one with a more notable improvement when the data distribution across the devices is not independent and identically distributed. The experimental results corroborate the convergence analysis, and show that a smaller number of local iterations should be used when the data distribution is more biased, and also when the devices have a better estimate of the global model in the analog downlink approach.en_US
dc.format.extent1422 - 1437en_US
dc.language.isoen_USen_US
dc.relation.ispartofIEEE Transactions on Wireless Communicationsen_US
dc.rightsAuthor's manuscripten_US
dc.titleConvergence of Federated Learning Over a Noisy Downlinken_US
dc.typeJournal Articleen_US
dc.identifier.doidoi:10.1109/twc.2021.3103874-
dc.identifier.eissn1558-2248-
pu.type.symplectichttp://www.symplectic.co.uk/publications/atom-terms/1.0/journal-articleen_US

Files in This Item:
File Description SizeFormat 
MAGKP_TWC21b.pdf4.94 MBAdobe PDFView/Download


Items in OAR@Princeton are protected by copyright, with all rights reserved, unless otherwise indicated.