arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2407.08977cs.CR
收藏

CURE:正确实现的隐私保护分割学习

CURE: Privacy-Preserving Split Learning Done Right

Koç University(博阿齐奇大学);Bilkent University(比尔肯特大学)

Halil Ibrahim Kanpak, Aqsa Shabbir, Esra Genç, Alptekin Küpçü, Sinem Sav

AI总结:

针对分割学习中服务器与客户端交换中间输出导致隐私泄露的问题,提出基于同态加密的CURE系统,通过加密模型服务器端和先进打包技术,在保持精度的同时将运行效率提升16倍。

摘要:

训练深度神经网络通常需要大规模数据集,由于计算限制,数据需在云服务器上存储和处理。在医疗等领域,流程必须遵循严格的隐私法规。分割学习(SL)是一种将模型层划分到客户端和服务器之间的框架,被广泛用于分布式模型训练。虽然分割学习通过限制服务器访问完整参数集降低了隐私风险,但先前的研究发现,服务器和客户端之间交换的中间输出可能损害客户端的数据隐私。针对此场景存在基于同态加密(HE)的解决方案,但往往带来过高的计算负担。为应对这些挑战,我们提出CURE,一种基于HE的新型系统,仅加密模型的服务器端以及可选的数据。CURE实现了安全的SL,同时通过先进的打包技术显著改善了通信和并行化。我们提出了两种打包方案,对于单层网络消耗一个HE层级,并将我们的解决方案推广到n层神经网络。我们证明,CURE可以达到与明文SL相似的精度,而在运行时间上比最先进的隐私保护替代方案高效16倍。

英文摘要:

Training deep neural networks often needs large datasets stored and processed in the cloud, and in sensitive fields like healthcare, these workflows must follow strict privacy rules. Split Learning (SL), a framework that divides model layers between client(s) and server(s), is widely adopted for distributed model training. While SL reduces privacy risks by limiting server access to the full parameter set, previous research has identified that intermediate outputs exchanged between server and client can compromise the client's data privacy. Homomorphic encryption (HE)-based solutions exist, but they often impose prohibitive computational burdens. To address these challenges, we propose CURE, a novel system based on HE for the single-client setting that encrypts only the server side of the model and optionally the data. CURE enables secure SL while substantially improving communication and parallelization. We propose packing schemes for efficient execution of deep learning algorithms and generalize them to MLPs and convolutional models, enabling the evaluation of large architectures using our implementations, such as ResNet blocks. We demonstrate that CURE can achieve similar accuracy to plaintext SL, while being up to 210x more efficient in terms of the runtime compared to the state-of-the-art privacy-preserving alternatives. Finally, we propose a novel estimator that enables efficient use of HE in SL settings by recommending an optimal server-client split.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑