arXivDaily arXiv每日学术速递 周一至周五更新
北美退伍军人节(Veterans Day),12 日无更新
arXiv 2303.04574cs.DC
收藏

分布式和深度垂直的大数据联邦学习

Distributed and Deep Vertical Federated Learning with Big Data

Ji Liu, Xuehai Zhou, Lei Mo, Shilei Ji, Yuan Liao, Zheng Li, Qin Gu, Dejing Dou

摘要:

近年来,数据通常分布在多个组织中,而数据安全变得越来越重要。联邦学习(Federated Learning,FL)使多个参与者能够在不交换原始数据的情况下协同训练模型,引起了越来越多的关注。基于数据的分布,FL可以在三个场景中实现,即,水平、垂直和混合。在本文中,我们提出了分布式机器学习技术与垂直FL相结合,并提出了分布式垂直联邦学习(DVFL)的方法。DVFL方法在每一方内部采用完全分布式的架构,以加快训练过程。此外,我们利用同态加密(HE)来保护数据免受诚实但好奇的参与者的攻击。我们在大规模集群环境和云环境中进行了广泛的实验,以显示我们提出的方法的效率和可扩展性。实验表明,我们的方法具有良好的可扩展性和显着的效率优势(高达6.8倍,单台服务器和15.1倍,多台服务器的训练时间)与基线框架相比。

英文摘要:

In recent years, data are typically distributed in multiple organizations while the data security is becoming increasingly important. Federated Learning (FL), which enables multiple parties to collaboratively train a model without exchanging the raw data, has attracted more and more attention. Based on the distribution of data, FL can be realized in three scenarios, i.e., horizontal, vertical, and hybrid. In this paper, we propose to combine distributed machine learning techniques with Vertical FL and propose a Distributed Vertical Federated Learning (DVFL) approach. The DVFL approach exploits a fully distributed architecture within each party in order to accelerate the training process. In addition, we exploit Homomorphic Encryption (HE) to protect the data against honest-but-curious participants. We conduct extensive experimentation in a large-scale cluster environment and a cloud environment in order to show the efficiency and scalability of our proposed approach. The experiments demonstrate the good scalability of our approach and the significant efficiency advantage (up to 6.8 times with a single server and 15.1 times with multiple servers in terms of the training time) compared with baseline frameworks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑