Using Synthetic Data to Reduce Model Convergence Time in Federated Learning

Fida K. Dankar, Nisha Madathil

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Federated Learning (FL) is a hot new topic in collaborative training of machine learning problems. It is a privacy-preserving distributed machine learning approach, allowing multiple clients to jointly train a global model under the coordination of a central server, while keeping their sensitive data private. The problem with FL systems is that they require intense communication between the server and clients to achieve the final machine learning model. Such complexity increases with the number of clients participating and the complexity of the model sought. In this paper, we introduce synthetic data generation into FL systems with the intention of reducing the number of iterations required for model convergence. In this novel method, clients generate synthetic datasets modeling their private data. The synthetic datasets are then sent to the central server and are used to generate a cognizant initial model. Our experiments show that such conscious method for generating the initial model lowers the number of iterations by a factor of more than 4 without affecting the model accuracy. As such it enhances the overall efficiency of FL systems.

Original languageEnglish
Title of host publicationProceedings of the 2022 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining, ASONAM 2022
EditorsJisun An, Chelmis Charalampos, Walid Magdy
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages293-297
Number of pages5
ISBN (Electronic)9781665456616
DOIs
Publication statusPublished - 2022
Externally publishedYes
Event14th IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining, ASONAM 2022 - Virtual, Online, Turkey
Duration: Nov 10 2022Nov 13 2022

Publication series

NameProceedings of the 2022 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining, ASONAM 2022

Conference

Conference14th IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining, ASONAM 2022
Country/TerritoryTurkey
CityVirtual, Online
Period11/10/2211/13/22

Keywords

  • federated learning
  • privacy preserving technologies
  • synthetic data

ASJC Scopus subject areas

  • Artificial Intelligence
  • Computer Networks and Communications
  • Information Systems
  • Information Systems and Management
  • Communication

Fingerprint

Dive into the research topics of 'Using Synthetic Data to Reduce Model Convergence Time in Federated Learning'. Together they form a unique fingerprint.

Cite this