arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2309.09025cs.CRcs.CY
收藏

基于FHE的高效隐私保护卷积脉冲神经网络

Efficient Privacy-Preserving Convolutional Spiking Neural Networks with FHE

Pengbo Li, Huifang Huang, Ting Gao, Jin Guo, Jinqiao Duan

AI总结:

本文提出FHE-DiCSNN框架,将TFHE全同态加密与脉冲神经网络的离散特性结合,并用卷积编码替代泊松编码,在MNIST密文上实现97.94%准确率且单次预测仅需0.75秒。

摘要:

随着人工智能技术的快速发展,我们见证了众多创新与便利。然而,伴随这些进步而来的是隐私威胁与风险。全同态加密(FHE)作为隐私保护计算的关键技术应运而生,它能够在保持数据隐私的同时进行计算。然而,FHE在处理连续非多项式函数方面存在局限,因为它仅限于离散整数,并且只支持加法和乘法。脉冲神经网络(SNNs)基于离散脉冲信号运行,天然地与FHE的特性相契合。在本文中,我们提出了一个名为FHE-DiCSNN的框架。该框架基于高效的TFHE方案,并利用SNNs的离散特性在密文上实现高预测性能。首先,通过采用自举(bootstrapping)技术,我们成功地在密文上实现了泄漏积分-发放(Leaky Integrate-and-Fire)神经元模型的计算。通过自举,我们可以支持任意深度的SNNs计算。该框架可以扩展到其他脉冲神经元模型,为SNNs的同态评估提供了一个新颖的框架。其次,受CNNs启发,我们采用卷积方法来替代泊松编码。这不仅提高了准确率,还缓解了由随机编码引起的模拟时间过长的问题。此外,我们采用工程技术将自举计算并行化,从而显著提高了计算效率。最后,我们在MNIST数据集上评估了我们的模型。实验结果表明,在最优参数配置下,FHE-DiCSNN在密文上实现了97.94%的准确率,与原始网络98.47%的准确率相比,损失仅为0.53%。此外,每次预测仅需0.75秒的计算时间。

英文摘要:

With the rapid development of AI technology, we have witnessed numerous innovations and conveniences. However, along with these advancements come privacy threats and risks. Fully Homomorphic Encryption (FHE) emerges as a key technology for privacy-preserving computation, enabling computations while maintaining data privacy. Nevertheless, FHE has limitations in processing continuous non-polynomial functions as it is restricted to discrete integers and supports only addition and multiplication. Spiking Neural Networks (SNNs) operate on discrete spike signals, naturally aligning with the properties of FHE. In this paper, we present a framework called FHE-DiCSNN. This framework is based on the efficient TFHE scheme and leverages the discrete properties of SNNs to achieve high prediction performance on ciphertexts. Firstly, by employing bootstrapping techniques, we successfully implement computations of the Leaky Integrate-and-Fire neuron model on ciphertexts. Through bootstrapping, we can facilitate computations for SNNs of arbitrary depth. This framework can be extended to other spiking neuron models, providing a novel framework for the homomorphic evaluation of SNNs. Secondly, inspired by CNNs, we adopt convolutional methods to replace Poisson encoding. This not only enhances accuracy but also mitigates the issue of prolonged simulation time caused by random encoding. Furthermore, we employ engineering techniques to parallelize the computation of bootstrapping, resulting in a significant improvement in computational efficiency. Finally, we evaluate our model on the MNIST dataset. Experimental results demonstrate that, with the optimal parameter configuration, FHE-DiCSNN achieves an accuracy of 97.94% on ciphertexts, with a loss of only 0.53% compared to the original network's accuracy of 98.47%. Moreover, each prediction requires only 0.75 seconds of computation time

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑