Efficient Encrypted Computation in Convolutional Spiking Neural Networks with TFHE
School of Cyber Science and Engineering, Huazhong University of Science and Technology(华中科技大学网络空间安全学院);School of Mathematics and Statistics, Huazhong University of Science and Technology(华中科技大学数学与统计学院);Center for Mathematical Science, Huazhong University of Science and Technology(华中科技大学数学中心);Steklov-Wuhan Institute for Mathematical Exploration, Huazhong University of Science and Technology(华中科技大学斯捷克洛夫-武汉数学探索研究所);Department of Mathematics and Department of Physics, Great Bay University(大湾区大学数学与物理学院);Guangdong Provincial Key Laboratory of Mathematical and Neural Dynamical Systems(广东省数学与神经动力系统重点实验室)
With the rapid advancement of AI technology, we have seen more and more concerns on data privacy, leading to some cutting-edge research on machine learning with encrypted computation. Fully Homomorphic Encryption (FHE) is a crucial technology for privacy-preserving computation, while it struggles with continuous non-polynomial functions, as it operates on discrete integers and supports only addition and multiplication. Spiking Neural Networks (SNNs), which use discrete spike signals, naturally complement FHE's characteristics. In this paper, we introduce FHE-DiCSNN, a framework built on the TFHE scheme, utilizing the discrete nature of SNNs for secure and efficient computations. By leveraging bootstrapping techniques, we successfully implement Leaky Integrate-and-Fire (LIF) neuron models on ciphertexts, allowing SNNs of arbitrary depth. Our framework is adaptable to other spiking neuron models, offering a novel approach to homomorphic evaluation of SNNs. Additionally, we integrate convolutional methods inspired by CNNs to enhance accuracy and reduce the simulation time associated with random encoding. Parallel computation techniques further accelerate bootstrapping operations. Experimental results on the MNIST and FashionMNIST datasets validate the effectiveness of FHE-DiCSNN, with a loss of less than 3\% compared to plaintext, respectively, and computation times of under 1 second per prediction. We also apply the model into real medical image classification problems and analyze the parameter optimization and selection.
GPU Acceleration of TFHE-Based High-Precision Nonlinear Layers for Encrypted LLM Inference
Peking University(北京大学);Mohamed bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学);Xiamen University(厦门大学);Nanjing University(南京大学);Ant Group(蚂蚁集团)
ComputeFHE: A Privacy-Preserving General-Purpose Computation Library
Department of Computer Engineering, Çankaya University, Ankara, Turkey(计算机工程系,恰纳卡大学,安卡拉,土耳其);Computer Programming Program, Çankaya University, Ankara, Turkey(计算机编程项目,恰纳卡大学,安卡拉,土耳其)
PrivSpike: Employing Homomorphic Encryption for Private Inference of Deep Spiking Neural Networks
STAM Center, Ira A. Fulton Schools of Engineering, Arizona State University(STAM中心、伊拉·A·福鲁顿工程学院、亚利桑那州立大学);Faculty of Technical Sciences, University of Novi Sad(技术科学学院、诺维萨德大学)