arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2103.14291cs.LG
收藏

分裂学习中训练顺序的脆弱性

Vulnerability Due to Training Order in Split Learning

Indian Institute of Science Education and Research, Pune(印度科学教育与研究学院浦那分校);DeepTek Inc(DeepTek公司)

Harshit Madaan, Manish Gawali, Viraj Kulkarni, Aniruddha Pant

摘要:

分裂学习(SL)是一种隐私保护的分布式深度学习方法,用于训练协作模型,而无需在客户端之间共享患者的原始数据。在分裂学习中,一个额外的隐私保护算法,称为no-peek算法,这是强大的对抗攻击。分裂学习提供的隐私优势使其适合医疗保健领域的实践。然而,分裂学习算法是有缺陷的,因为协作模型是顺序训练的,即,客户一个接一个地训练我们指出,使用分裂学习算法训练的模型在一轮结束时偏向于用于训练的客户端的数据。这使得SL算法非常容易受到客户端被考虑用于训练的顺序的影响。我们证明,使用所有客户端的数据训练的模型在客户端的数据上表现不佳,这些数据在一轮训练模型中被认为是最早的。此外,我们发现,这种影响变得更加突出的客户端的数量的增加。我们还证明了SplitFedv 3算法缓解了这个问题,同时仍然利用分裂学习提供的隐私优势。

英文摘要:

Split learning (SL) is a privacy-preserving distributed deep learning method used to train a collaborative model without the need for sharing of patient's raw data between clients. In split learning, an additional privacy-preserving algorithm called no-peek algorithm can be incorporated, which is robust to adversarial attacks. The privacy benefits offered by split learning make it suitable for practice in the healthcare domain. However, the split learning algorithm is flawed as the collaborative model is trained sequentially, i.e., one client trains after the other. We point out that the model trained using the split learning algorithm gets biased towards the data of the clients used for training towards the end of a round. This makes SL algorithms highly susceptible to the order in which clients are considered for training. We demonstrate that the model trained using the data of all clients does not perform well on the client's data which was considered earliest in a round for training the model. Moreover, we show that this effect becomes more prominent with the increase in the number of clients. We also demonstrate that the SplitFedv3 algorithm mitigates this problem while still leveraging the privacy benefits provided by split learning.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑