More Web Proxy on the site http://driver.im/

research-article

EFMVFL: An Efficient and Flexible Multi-party Vertical Federated Learning without a Third Party

Authors:

Ming YaoAuthors Info & Claims

ACM Transactions on Knowledge Discovery from Data, Volume 18, Issue 3

Article No.: 51, Pages 1 - 20

https://doi.org/10.1145/3627993

Published: 09 December 2023 Publication History

Abstract

Federated learning (FL) is a machine learning setting which allows multiple participants collaboratively to train a model under the orchestration of a server without disclosing their local data. Vertical federated learning (VFL) is a special structure in FL. It handles the situation where participants have the same ID space but different feature spaces. In order to guarantee the security and privacy of the local data of each participant, homomorphic encryption (HE) is often used to transmit intermediate parameters or data during the training process. In most VFL frameworks, a trusted third-party server is necessary because the plaintexts of the parameters need to be revealed for the computation. However, it is hard to find such a credible entity in the real world. Existing methods for solving this problem are either communication-intensive or unsuitable for multi-party scenarios. By combining secret sharing (SS) and HE, we propose a novel VFL framework without any trusted third parties called EFMVFL. It allows intermediate parameters to be transmitted among multiple parties without revealing the plaintexts. EFMVFL is applicable to generalized linear models (GLMs) and supports flexible expansion to multiple participants. Extensive experiments under Logistic Regression and Poisson Regression show that our framework is outstanding in communication (reduced by 3.2×– 6.8×) and efficiency (accelerated by 1.6×– 3.1×).

References

[1]

Ibrahim Aliyu, Marco Carlo Feliciano, Sélinde van Engelenburg, Dong Ok Kim, and Chang Gyoon Lim. 2021. A blockchain-based federated forest for SDN-enabled in-vehicle network intrusion detection system. IEEE Access 9 (2021), 102593–102608. DOI:

[2]

Donald Beaver. 1991. Efficient multiparty protocols using circuit randomization. In Proceedings of the Advances in Cryptology—CRYPTO ’91, 11th Annual International Cryptology Conference.Joan Feigenbaum (Ed.), Vol. 576, Lecture Notes in Computer Science, Springer, 420–432. DOI:

[3]

Chaochao Chen, Jun Zhou, Li Wang, Xibin Wu, Wenjing Fang, Jin Tan, Lei Wang, Alex X. Liu, Hao Wang, and Cheng Hong. 2021. When homomorphic encryption marries secret sharing: Secure large-scale sparse logistic regression and applications in risk control. In Proceedings of the KDD ’21: The 27th ACM SIGKDD Conference on Knowledge Discovery and Data Mining.Feida Zhu, Beng Chin Ooi, and Chunyan Miao (Eds.), ACM, 2652–2662. DOI:

Digital Library

[4]

Kewei Cheng, Tao Fan, Yilun Jin, Yang Liu, Tianjian Chen, Dimitrios Papadopoulos, and Qiang Yang. 2021. SecureBoost: A lossless federated learning framework. IEEE Intelligent Systems 36, 6 (2021), 87–98. DOI:

Digital Library

[5]

Haokun Fang and Quan Qian. 2021. Privacy preserving machine learning with homomorphic encryption and federated learning. Future Internet 13, 4 (2021), 94. DOI:

[6]

FU Fangcheng, LIU Shu, CHENG Yong, and TAO Yangyu. 2022. Vertical federated logistic regression via homomorphic encryption and secret sharing. Information and Communications Technology and Policy 48, 5 (2022), 34.

[7]

Stephen Hardy, Wilko Henecka, Hamish Ivey-Law, Richard Nock, Giorgio Patrini, Guillaume Smith, and Brian Thorne. 2017. Private federated learning on vertically partitioned data via entity resolution and additively homomorphic encryption. arXiv:1711.10677. Retrieved from https://arxiv.org/abs/1711.10677

[8]

Mahimna Kelkar, Phi Hung Le, Mariana Raykova, and Karn Seth. 2022. Secure Poisson Regression. In 31st USENIX Security Symposium (USENIX Security 22). USENIX Association, Boston, MA, 791–808. https://www.usenix.org/conference/usenixsecurity22/presentation/kelkar

[9]

Marcel Keller. 2020. MP-SPDZ: A versatile framework for multi-party computation. In Proceedings of the CCS ’20: 2020 ACM SIGSAC Conference on Computer and Communications Security.Jay Ligatti, Xinming Ou, Jonathan Katz, and Giovanni Vigna (Eds.), ACM, 1575–1590. DOI:

Digital Library

[10]

Miran Kim, Yongsoo Song, Shuang Wang, Yuhou Xia, and Xiaoqian Jiang. 2018. Secure Logistic Regression Based on Homomorphic Encryption: Design and Evaluation. JMIR Med Inform 6, 2 (2018), e19.

[11]

Jakub Konečný, H. Brendan McMahan, Felix X. Yu, Peter Richtárik, Ananda Theertha Suresh, and Dave Bacon. 2016. Federated learning: Strategies for improving communication efficiency. arXiv:1610.05492. Retrieved from https://arxiv.org/abs/1610.05492

[12]

Eunsang Lee, Joon-Woo Lee, Junghyun Lee, Young-Sik Kim, Yongjune Kim, Jong-Seon No, and Woosuk Choi. 2022. Low-Complexity Deep Convolutional Neural Networks on Fully Homomorphic Encryption Using Multiplexed Parallel Convolutions. In Proceedings of the 39th International Conference on Machine Learning (Proceedings of Machine Learning Research, Vol. 162), Kamalika Chaudhuri, Stefanie Jegelka, Le Song, Csaba Szepesvari, Gang Niu, and Sivan Sabato (Eds.). PMLR, 12403–12422. https://proceedings.mlr.press/v162/lee22e.html

[13]

Brendan McMahan, Eider Moore, Daniel Ramage, Seth Hampson, and Blaise Agüera y Arcas. 2017. Communication-efficient learning of deep networks from decentralized data. In Proceedings of the 20th International Conference on Artificial Intelligence and Statistics.Aarti Singh and Xiaojin (Jerry) Zhu (Eds.), Proceedings of Machine Learning Research, Vol. 54, PMLR, 1273–1282. Retrieved from http://proceedings.mlr.press/v54/mcmahan17a.html

[14]

H. Brendan McMahan, Eider Moore, Daniel Ramage, and Blaise Agüera y Arcas. 2016. Federated learning of deep networks using model averaging. arXiv:abs/1602.05629. Retrieved from https://arxiv.org/abs/abs/1602.05629

[15]

Payman Mohassel and Peter Rindal. 2018. ABY\({}^{\mbox{3}}\): A mixed protocol framework for machine learning. In Proceedings of the 2018 ACM SIGSAC Conference on Computer and Communications Security, CCS 2018.David Lie, Mohammad Mannan, Michael Backes, and XiaoFeng Wang (Eds.), ACM, 35–52. DOI:

Digital Library

[16]

Payman Mohassel and Yupeng Zhang. 2017. SecureML: A system for scalable privacy-preserving machine learning. In Proceedings of the 2017 IEEE Symposium on Security and Privacy, SP 2017. IEEE Computer Society, 19–38. DOI:

[17]

Swaroop Ramaswamy, Rajiv Mathews, Kanishka Rao, and Françoise Beaufays. 2019. Federated learning for emoji prediction in a mobile keyboard. arXiv:1906.04329. Retrieved from https://arxiv.org/abs/1906.04329

[18]

Adi Shamir. 1979. How to share a secret. Communications of the ACM 22, 11 (1979), 612–613. DOI:

Digital Library

[19]

Lichao Sun, Jianwei Qian, and Xun Chen. 2021. LDP-FL: Practical private aggregation in federated learning with local differential privacy. In Proceedings of the 30th International Joint Conference on Artificial Intelligence.Zhi-Hua Zhou (Ed.), ijcai.org, 1571–1578. DOI:

[20]

Sameer Wagh, Divya Gupta, and Nishanth Chandran. 2019. SecureNN: 3-party secure computation for neural network training. Proceedings on Privacy Enhancing Technologies 2019, 3 (2019), 26–49. DOI:

[21]

Qianjun Wei, Qiang Li, Zhipeng Zhou, ZhengQiang Ge, and Yonggang Zhang. 2021. Privacy-preserving two-parties logistic regression on vertically partitioned data using asynchronous gradient sharing. Peer-to-Peer Networking and Applications 14, 3 (2021), 1379–1387. DOI:

[22]

Yuncheng Wu, Shaofeng Cai, Xiaokui Xiao, Gang Chen, and Beng Chin Ooi. 2020. Privacy preserving vertical federated learning for tree-based models. Proceedings of the VLDB Endowment 13, 11 (2020), 2090–2103. Retrieved from http://www.vldb.org/pvldb/vol13/p2090-wu.pdf

Digital Library

[23]

Qiang Yang, Yang Liu, Tianjian Chen, and Yongxin Tong. 2019. Federated machine learning: Concept and applications. ACMTransactions on Intelligent Systems and Technology 10, 2 (2019), 12:1–12:19. DOI:

Digital Library

[24]

Shengwen Yang, Bing Ren, Xuhui Zhou, and Liping Liu. 2019. Parallel distributed logistic regression for vertical federated learning without third-party coordinator. arXiv:1911.09824. Retrieved from https://arxiv.org/abs/1911.09824

[25]

Andrew Chi-Chih Yao. 1982. Protocols for secure computations (extended abstract). In Proceedings of the 23rd Annual Symposium on Foundations of Computer Science. IEEE Computer Society, 160–164. DOI:

[26]

Qiao Zhang, Cong Wang, Hongyi Wu, Chunsheng Xin, and Tran V. Phuong. 2018. GELU-Net: A globally encrypted, locally unencrypted deep neural network for privacy-preserved learning. In Proceedings of the 27th International Joint Conference on Artificial Intelligence, IJCAI 2018.Jérôme Lang (Ed.), ijcai.org, 3933–3939. DOI:

[27]

Yifei Zhang and Hao Zhu. 2020. Additively homomorphical encryption based deep neural network for asymmetrically collaborative machine learning. arXiv:2007.06849. Retrieved from https://arxiv.org/abs/2007.06849

[28]

Di Zhao, Ming Yao, Wanwan Wang, Hao He, and Xin Jin. 2022. NTP-VFL - A new scheme for non-3rd party vertical federated learning. In Proceedings of the ICMLC 2022: 14th International Conference on Machine Learning and Computing. ACM, 134–139. DOI:

Digital Library

[29]

Huafei Zhu, Rick Siow Mong Goh, and Wee Keong Ng. 2020. Privacy-preserving weighted federated learning within the secret sharing framework. IEEE Access 8 (2020), 198275–198284. DOI:

[30]

Ligeng Zhu and Song Han. 2020. Deep leakage from gradients. In Proceedings of the Federated Learning—Privacy and Incentive. Qiang Yang, Lixin Fan, and Han Yu (Eds.), Lecture Notes in Computer Science, Vol. 12500, Springer, 17–31. DOI:

Cited By

Tang H(2025)Analysis of Vertical Federated Technology for Effective Financing of Small and Medium-Sized Enterprises Based on Three-Party Evolutionary GameInternational Journal of Knowledge Management10.4018/IJKM.37031721:1(1-24)Online publication date: 26-Feb-2025
https://doi.org/10.4018/IJKM.370317
Tang XWang YLiu XYuan XFan CHu YMiao Q(2025)Federated graph neural network for privacy-preserved supply chain data sharingApplied Soft Computing10.1016/j.asoc.2024.112475168:COnline publication date: 1-Jan-2025
https://dl.acm.org/doi/10.1016/j.asoc.2024.112475
Fan MZhang ZLi ZSun GYu HKang JGuizani M(2024)SecureVFL: privacy-preserving multi-party vertical federated learning based on blockchain and RSSDigital Communications and Networks10.1016/j.dcan.2024.07.008Online publication date: Aug-2024
https://doi.org/10.1016/j.dcan.2024.07.008

Recommendations

Privacy-enhanced multi-party deep learning
Abstract
In multi-party deep learning, multiple participants jointly train a deep learning model through a central server to achieve common objectives without sharing their private data. Recently, a significant amount of progress has been made ...
Contract-based hierarchical security aggregation scheme for enhancing privacy in federated learning
Abstract
Federated learning ensures the privacy of participant data by uploading gradients rather than private data. However, it has yet to address the issue of untrusted aggregators using gradient inference attacks to obtain user privacy data. Current ...
Secure Multi-Party Computation without Agreement

It has recently been shown that authenticated Byzantine agreement, in which more than a third of the parties are corrupted, cannot be securely realized under concurrent or parallel (stateless) composition. This result puts into question any usage of ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Transactions on Knowledge Discovery from Data

ACM Transactions on Knowledge Discovery from Data Volume 18, Issue 3

April 2024

663 pages

EISSN:1556-472X

DOI:10.1145/3613567

Editor:
Charu Aggarwal
IBM T. J. Watson Research, USA

Issue’s Table of Contents

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 09 December 2023

Online AM: 17 October 2023

Accepted: 12 October 2023

Revised: 14 August 2023

Received: 12 September 2022

Published in TKDD Volume 18, Issue 3

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
400
Total Downloads

Downloads (Last 12 months)224
Downloads (Last 6 weeks)10

Reflects downloads up to 03 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Tang H(2025)Analysis of Vertical Federated Technology for Effective Financing of Small and Medium-Sized Enterprises Based on Three-Party Evolutionary GameInternational Journal of Knowledge Management10.4018/IJKM.37031721:1(1-24)Online publication date: 26-Feb-2025
https://doi.org/10.4018/IJKM.370317
Tang XWang YLiu XYuan XFan CHu YMiao Q(2025)Federated graph neural network for privacy-preserved supply chain data sharingApplied Soft Computing10.1016/j.asoc.2024.112475168:COnline publication date: 1-Jan-2025
https://dl.acm.org/doi/10.1016/j.asoc.2024.112475
Fan MZhang ZLi ZSun GYu HKang JGuizani M(2024)SecureVFL: privacy-preserving multi-party vertical federated learning based on blockchain and RSSDigital Communications and Networks10.1016/j.dcan.2024.07.008Online publication date: Aug-2024
https://doi.org/10.1016/j.dcan.2024.07.008

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Full Text

View this article in Full Text.

Figures

Tables

Media

View full text|Download PDF

View Issue’s Table of Contents