arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2008.09874cs.LGstat.ML
收藏

使用分裂学习的多分类

Multiple Classification with Split Learning

Gwangju Institute of Science and Technology(光州科学技术院)

Jongwon Kim, Sungho Shin, Yeonguk Yu, Junseok Lee, Kyoobin Lee

摘要:

在医疗、移动和其他领域的深度学习培训过程中,出现了隐私问题。为了解决这个问题,我们提出了隐私保护的分布式深度学习方法,允许客户端在不直接暴露的情况下学习各种数据。我们将单个深度学习架构划分为通用提取器、云模型和用于分布式学习的本地分类器。首先,由本地客户端使用的公共提取器从输入数据中提取安全特征。安全功能还发挥作用,云模型可以使用各种任务和不同类型的数据。该功能包含有助于进行各种任务的最重要的信息。第二,云模型包含了整个训练模型的大部分内容,它从大量的本地客户端获取嵌入的特征,并执行大部分的深度学习操作,这需要大量的计算成本。在云模型中的操作完成后,云模型的输出发送回本地客户端。最后,本地分类器确定分类结果,并将结果交付给本地客户端。在客户端对模型进行训练时,我们的模型不直接将敏感信息暴露给外部网络。在测试过程中,与现有的本地培训模型相比,平均性能提高了2.63%。然而,在分布式环境中,由于暴露的特征,存在反转攻击的可能性。出于这个原因,我们尝试使用常见的提取器来防止数据恢复。通过调整常用提取器的深度,测试了原始图像的恢复质量。结果,我们发现,越深的共同提取器,恢复得分下降到89.74。

英文摘要:

Privacy issues were raised in the process of training deep learning in medical, mobility, and other fields. To solve this problem, we present privacy-preserving distributed deep learning method that allow clients to learn a variety of data without direct exposure. We divided a single deep learning architecture into a common extractor, a cloud model and a local classifier for the distributed learning. First, the common extractor, which is used by local clients, extracts secure features from the input data. The secure features also take the role that the cloud model can employ various task and diverse types of data. The feature contain the most important information that helps to proceed various task. Second, the cloud model including most parts of the whole training model gets the embedded features from the massive local clients, and performs most of deep learning operations which takes severe computing cost. After the operations in cloud model finished, outputs of the cloud model send back to local clients. Finally, the local classifier determined classification results and delivers the results to local clients. When clients train models, our model does not directly expose sensitive information to exterior network. During the test, the average performance improvement was 2.63% over the existing local training model. However, in a distributed environment, there is a possibility of inversion attack due to exposed features. For this reason, we experimented with the common extractor to prevent data restoration. The quality of restoration of the original image was tested by adjusting the depth of the common extractor. As a result, we found that the deeper the common extractor, the restoration score decreased to 89.74.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑