THF: 3-way hierarchical framework for efficient client selection and resource management in federated learning

Muhammad Asad, Ahmed Moustafa, Fethi A. Rabhi, Muhammad Aslam

Research output: Contribution to journalArticlepeer-review

9 Downloads (Pure)

Abstract

Federated Learning (FL) is a promising technique for collaboratively training machine learning models on massively distributed clients data under privacy constraints. However, the existing FL literature focuses on speeding-up the learning process and ignores minimizing the communication cost which is critical for resource-constrained clients. To this end, in this paper, we propose a novel 3-way hierarchical framework (THF) to promote communication efficiency in FL. Using the proposed framework, only a cluster-head (CH) communicates with the cloud server through edge-aggregation in order to minimize the communication cost of clients. In particular, the clients upload their local models to their respective CHs, which are responsible to forward them to the corresponding edge-server. The edge-server averages the local models and iterates until it achieves the edge-accuracy. Afterward, each edge-server uploads the edge-models to the cloud server for global aggregation. In this way, model downloading and uploading requires less bandwidth due to the short distance from source to destination that makes an efficient 3-way hierarchical network structure. In addition, we formulate a joint communication and computation resource management scheme through efficient client selection in order to achieve global cost minimization in FL. We conduct extensive empirical evaluations on diverse data learning tasks on multiple datasets to signify that THF achieves global cost savings and converges within fewer communication rounds compared to other FL approaches.
Original languageEnglish
Number of pages13
JournalIEEE Internet of Things Journal
Early online date13 Nov 2021
DOIs
Publication statusE-pub ahead of print - 13 Nov 2021

Keywords

  • federated learning
  • client selection
  • resource management
  • edge-aggregation

Fingerprint

Dive into the research topics of 'THF: 3-way hierarchical framework for efficient client selection and resource management in federated learning'. Together they form a unique fingerprint.

Cite this