Mobile_FL: A streamlined FL framework for process optimisation via client clustering using rough c-means algorithm
Authors: 
Akarsh K. Nair, Jayakrushna Sahoo, Linga Reddy Cenkeramaddi, 
Gaurav Jaswal, Ebin Deni RajAuthors Info & Claims
Pages 88 - 97
Abstract
Currently, Federated Learning is one of the most widely accepted distributed learning frameworks for privacy-sensitive applications. Despite the popularity gained, FL frameworks struggle to perform well in terms of accuracy and model convergence for scenarios with diverse clients and data distributions. For tackling such issues, the article presents a clustered FL framework, Mobile_FL exploiting model similarities between clients to group them into clusters with collaboratively trainable private datasets. The Mobile_FL framework employs a multi-tier clustering approach with intermediate aggregation ensuring streamlined convergence and model performance compared to existing models. The intermediate servers are termed virtual servers and clustering is performed based on a strategy inspired from the classical rough c means clustering approach. The rough c means ensures computational efficiency with an effective complexity-system performance trade-off compared to complex algorithms. The intermediate layers also act as a deterrent against curious servers, enhancing both system privacy and user anonymity for clients. The framework is also ideally suited for generating personalized FL models for a subgroup of clients, especially in mobile environments with dynamic client populations. The performance of the model is verified through experiments on standard datasets and also subjected to theoretic analysis.
References
[1]
2023. Heterogeneous Federated Learning: State-of-the-Art and Research Challenges. ACM Comput. Surv. 56, 3, Article 79 (oct 2023), 44 pages. https://doi.org/10.1145/3625558
[2]
Abdullatif Albaseer, Mohamed Abdallah, Ala Al-Fuqaha, and Aiman Erbad. 2021. Client Selection Approach in Support of Clustered Federated Learning over Wireless Edge Networks. In 2021 IEEE Global Communications Conference (GLOBECOM). 1--6. https://doi.org/10.1109/GLOBECOM46510.2021.9685938
[3]
Laizhong Cui, Xiaoxin Su, Yipeng Zhou, and Yi Pan. 2021. Slashing Communication Traffic in Federated Learning by Transmitting Clustered Model Updates. IEEE Journal on Selected Areas in Communications 39, 8 (2021), 2572--2589. https://doi.org/10.1109/JSAC.2021.3087262
[4]
Moming Duan, Duo Liu, Xinyuan Ji, Yu Wu, Liang Liang, Xianzhang Chen, Yujuan Tan, and Ao Ren. 2022. Flexible Clustered Federated Learning for Client-Level Data Distribution Shift. IEEE Transactions on Parallel and Distributed Systems 33, 11 (2022), 2661--2674. https://doi.org/10.1109/TPDS.2021.3134263
[5]
Wenli Duo, MengChu Zhou, and Abdullah Abusorrah. 2022. A Survey of Cyber Attacks on Cyber Physical Systems: Recent Advances and Challenges. IEEE/CAA Journal of Automatica Sinica 9, 5 (2022), 784--800. https://doi.org/10.1109/JAS.2022.105548
[6]
Avishek Ghosh, Jichan Chung, Dong Yin, and Kannan Ramchandran. 2020. An Efficient Framework for Clustered Federated Learning. In Advances in Neural Information Processing Systems, H. Larochelle, M. Ranzato, R. Hadsell, M.F. Balcan, and H. Lin (Eds.), Vol. 33. Curran Associates, Inc., 19586--19597. https://proceedings.neurips.cc/paper/2020/file/e32cc80bf07915058ce90722ee17bb71-Paper.pdf
[7]
Avishek Ghosh, Jichan Chung, Dong Yin, and Kannan Ramchandran. 2022. An Efficient Framework for Clustered Federated Learning. IEEE Transactions on Information Theory 68, 12 (2022), 8076--8091. https://doi.org/10.1109/TIT.2022.3192506
[8]
Hai Jin, Xiaohai Dai, Jiang Xiao, Baochun Li, Huichuwu Li, and Yan Zhang. 2021. Cross-Cluster Federated Learning and Blockchain for Internet of Medical Things. IEEE Internet of Things Journal 8, 21 (2021), 15776--15784. https://doi.org/10.1109/JIOT.2021.3081578
[9]
Chengxi Li, Gang Li, and Pramod K. Varshney. 2022. Federated Learning With Soft Clustering. IEEE Internet of Things Journal 9, 10 (2022), 7773--7782. https://doi.org/10.1109/JIOT.2021.3113927
[10]
Daiwei Li, Haiqing Zhang, Tianrui Li, Abdelaziz Bouras, Xi Yu, and Tao Wang. 2022. Hybrid Missing Value Imputation Algorithms Using Fuzzy C-Means and Vaguely Quantified Rough Set. IEEE Transactions on Fuzzy Systems 30, 5 (2022), 1396--1408. https://doi.org/10.1109/TFUZZ.2021.3058643
[11]
Andrey Malinin and Mark Gales. 2019. Reverse KL-Divergence Training of Prior Networks: Improved Uncertainty and Adversarial Robustness. In Advances in Neural Information Processing Systems, H. Wallach, H. Larochelle, A. Beygelzimer, F. d'Alché-Buc, E. Fox, and R. Garnett (Eds.), Vol. 32. Curran Associates, Inc. https://proceedings.neurips.cc/paper_files/paper/2019/file/7dd2ae7db7d18ee7c9425e38df1af5e2-Paper.pdf
[12]
Aniket Murhekar, Zhuowen Yuan, Bhaskar Ray Chaudhury, Bo Li, and Ruta Mehta. 2023. Incentives in Federated Learning: Equilibria, Dynamics, and Mechanisms for Welfare Maximization. In Advances in Neural Information Processing Systems, A. Oh, T. Neumann, A. Globerson, K. Saenko, M. Hardt, and S. Levine (Eds.), Vol. 36. Curran Associates, Inc., 17811--17831. https://proceedings.neurips.cc/paper_files/paper/2023/file/39b77b5e422b4e070e2811b73ea9bcf7-Paper-Conference.pdf
[13]
Akarsh K. Nair, Jayakrushna Sahoo, and Ebin Deni Raj. 2023. Privacy preserving Federated Learning framework for IoMT based big data analysis using edge computing. Computer Standards & Interfaces 86 (2023), 103720. https://doi.org/10.1016/j.csi.2023.103720
[14]
Alexandru Nelus, Rene Glitza, and Rainer Martin. 2021. Unsupervised Clustered Federated Learning in Complex Multi-source Acoustic Environments. In 2021 29th European Signal Processing Conference (EUSIPCO). 1115--1119. https://doi.org/10.23919/EUSIPCO54536.2021.9615980
[15]
Dinh C. Nguyen, Ming Ding, Quoc-Viet Pham, Pubudu N. Pathirana, Long Bao Le, Aruna Seneviratne, Jun Li, Dusit Niyato, and H. Vincent Poor. 2021. Federated Learning Meets Blockchain in Edge Computing: Opportunities and Challenges. IEEE Internet of Things Journal 8, 16 (2021), 12806--12825. https://doi.org/10.1109/JIOT.2021.3072611
[16]
Xiaomin Ouyang, Zhiyuan Xie, Jiayu Zhou, Guoliang Xing, and Jianwei Huang. 2022. ClusterFL: A Clustering-Based Federated Learning System for Human Activity Recognition. ACM Trans. Sen. Netw. 19, 1, Article 17 (dec 2022), 32 pages. https://doi.org/10.1145/3554980
[17]
Yichen Ruan and Carlee Joe-Wong. 2022. FedSoft: Soft Clustered Federated Learning with Proximal Local Updating. Proceedings of the AAAI Conference on Artificial Intelligence 36, 7 (Jun. 2022), 8124--8131. https://doi.org/10.1609/aaai.v36i7.20785
[18]
Felix Sattler, Klaus-Robert Müller, and Wojciech Samek. 2020. Clustered federated learning: Model-agnostic distributed multitask optimization under privacy constraints. IEEE transactions on neural networks and learning systems 32, 8 (2020), 3710--3722.
[19]
Anuj Kumar Singh and Sachin Kumar. 2024. An efficient and secure CLAKA protocol for blockchain-aided wireless body area networks. Expert Systems with Applications 242 (2024), 122740. https://doi.org/10.1016/j.eswa.2023.122740
[20]
Tingting Wang, Tao Tang, Zhen Cai, Kai Fang, Jinyu Tian, Jianqing Li, Wei Wang, and Feng Xia. 2024. Federated Learning-based Information Leakage Risk Detection for Secure Medical Internet of Things. ACM Trans. Internet Technol. (jan 2024). https://doi.org/10.1145/3639466 Just Accepted.
[21]
Xuefei Yin, Yanming Zhu, and Jiankun Hu. 2021. A Comprehensive Survey of Privacy-Preserving Federated Learning: A Taxonomy, Review, and Future Directions. ACM Comput. Surv. 54, 6, Article 131 (jul 2021), 36 pages. https://doi.org/10.1145/3460427
[22]
Jie Zhang, Song Guo, Zhihao Qu, Deze Zeng, Yufeng Zhan, Qifeng Liu, and Rajendra Akerkar. 2022. Adaptive Federated Learning on Non-IID Data With Resource Constraint. IEEE Trans. Comput. 71, 7 (2022), 1655--1667. https://doi.org/10.1109/TC.2021.3099723
Recommendations
Ant clustering algorithm with K-harmonic means clustering
Clustering is an unsupervised learning procedure and there is no a prior knowledge of data distribution. It organizes a set of objects/data into similar groups called clusters, and the objects within one cluster are highly similar and dissimilar with ...
Improved k- means clustering algorithm for two dimensional data
CCSEIT '12: Proceedings of the Second International Conference on Computational Science, Engineering and Information TechnologyClustering is a procedure of organizing the objects in groups whose member exhibits some kind of similarity. So a cluster is a collection of objects which are alike and are different from the objects belonging to other clusters. K-Means is one of ...
Hybrid Bisect K-Means Clustering Algorithm
BCGIN '11: Proceedings of the 2011 International Conference on Business Computing and Global InformatizationIn this paper, we present a hybrid clustering algorithm that combines divisive and agglomerative hierarchical clustering algorithm. Our method uses bisect K-means for divisive clustering algorithm and Unweighted Pair Group Method with Arithmetic Mean (...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
July 2024
116 pages
Copyright © 2024 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 01 July 2024
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Conference
ASIA CCS '24
Sponsor:
ASIA CCS '24: ACM Asia Conference on Computer and Communications Security
July 2, 2024
Singapore, Singapore
Acceptance Rates
CPSS '24 Paper Acceptance Rate 10 of 22 submissions, 45%;
Overall Acceptance Rate 43 of 135 submissions, 32%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 36Total Downloads
- Downloads (Last 12 months)36
- Downloads (Last 6 weeks)3
Reflects downloads up to 24 Jan 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in