arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2106.07229cs.LGcs.CR
收藏

基于全同态加密的深度神经网络隐私保护机器学习

Privacy-Preserving Machine Learning with Fully Homomorphic Encryption for Deep Neural Network

Seoul National University(首尔国立大学);Samsung Advanced Institute of Technology(三星先进技术研究院)

Joon-Woo Lee, HyungChul Kang, Yongwoo Lee, Woosuk Choi, Jieun Eom, Maxim Deryabin, Eunsang Lee, Junghyun Lee, Donghoon Yoo, Young-Sik Kim, Jong-Seon No

摘要:

全同态加密(FHE)是保护隐私的机器学习(PPML)的一种很有前途的工具,基于不同的FHE方案和方法已经提出了多种PPML模型。虽然FHE方案被认为是实现PPML模型的合适工具,但是先前关于FHE加密数据的PPML模型仅限于简单和非标准类型的机器学习模型。这些非标准的机器学习模型在更实用和更先进的数据集上并没有被证明是有效和准确的。以前的PPML方案用简单的算术函数代替非算术激活函数,而不是采用近似方法,并且不使用自举,这使得连续的同态评估成为可能。因此,它们不能使用标准的激活函数,也不能使用大量的层。到目前为止,CIFAR-10数据集的FHE现有PPML模型的最大分类准确率仅为77%。在这项工作中,我们首先使用RNS-CKKS FHE实现了标准的ResNet-20模型,并使用CIFAR-10数据集和明文模型参数验证了所实现的模型。我们没有用简单的算术函数替换非算术函数,而是使用最先进的近似方法来评估这些非算术函数,例如ReLU,具有足够的精度[1]。此外,我们第一次在所提出的模型中使用RNS-CKKS方案的自举技术,这使我们能够在加密数据上评估深度学习模型。我们在数值上验证了所提出的模型与CIFAR-10数据集的结果与原始ResNet-20模型的结果有98.67%相同。该模型的分类准确率为90.67%,与原始ResNet-20 CNN模型的分类准确率非常接近。

英文摘要:

Fully homomorphic encryption (FHE) is one of the prospective tools for privacypreserving machine learning (PPML), and several PPML models have been proposed based on various FHE schemes and approaches. Although the FHE schemes are known as suitable tools to implement PPML models, previous PPML models on FHE encrypted data are limited to only simple and non-standard types of machine learning models. These non-standard machine learning models are not proven efficient and accurate with more practical and advanced datasets. Previous PPML schemes replace non-arithmetic activation functions with simple arithmetic functions instead of adopting approximation methods and do not use bootstrapping, which enables continuous homomorphic evaluations. Thus, they could not use standard activation functions and could not employ a large number of layers. The maximum classification accuracy of the existing PPML model with the FHE for the CIFAR-10 dataset was only 77% until now. In this work, we firstly implement the standard ResNet-20 model with the RNS-CKKS FHE with bootstrapping and verify the implemented model with the CIFAR-10 dataset and the plaintext model parameters. Instead of replacing the non-arithmetic functions with the simple arithmetic function, we use state-of-the-art approximation methods to evaluate these non-arithmetic functions, such as the ReLU, with sufficient precision [1]. Further, for the first time, we use the bootstrapping technique of the RNS-CKKS scheme in the proposed model, which enables us to evaluate a deep learning model on the encrypted data. We numerically verify that the proposed model with the CIFAR-10 dataset shows 98.67% identical results to the original ResNet-20 model with non-encrypted data. The classification accuracy of the proposed model is 90.67%, which is pretty close to that of the original ResNet-20 CNN model...

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑