arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2311.03470cs.CR
收藏

Orion:面向深度学习的全同态加密框架

Orion: A Fully Homomorphic Encryption Framework for Deep Learning

Austin Ebel, Karthik Garimella, Brandon Reagen

AI总结:

本文提出全自动框架Orion,通过新型单步多路复用打包策略及自动化引导放置技术,将PyTorch编写的深度神经网络转换为高效FHE程序,在ResNet-20上性能超现有技术2.38倍,还支持ResNet-50和YOLO-v1等大型模型的FHE推理。

摘要:

全同态加密(FHE)能够直接对加密数据进行计算,有望大幅提升隐私和安全性。这一点在深度学习领域尤为重要,因为如今许多流行的用户服务都由云端的神经网络提供支持。除了众所周知的高计算成本外,大规模部署FHE安全神经推理面临的主要挑战之一是如何有效地将这些网络映射到FHE原语。FHE带来了诸多编程挑战,包括打包大型向量、管理累积噪声,以及将任意通用程序转换为FHE提供的有限指令集。这些挑战使得使用现有工具构建大型FHE神经网络变得难以实现。本文中,我们通过Orion解决了这些挑战,Orion是一个用于基于FHE的私有神经推理的全自动框架。Orion接受用PyTorch编写的深度神经网络,并将其转换为高效的FHE程序。我们通过提出一种用于任意卷积的新型单步多路复用打包策略,以及一种自动化引导放置和规模管理的高效技术来实现这一点。我们在FHE深度学习社区使用的常见基准上评估Orion,在他们报告的最大网络ResNet-20上性能优于现有技术2.38倍。Orion的技术能够处理更深、更大的网络。我们通过在ImageNet上评估ResNet-50来证明这一点,并展示了使用具有1.39亿参数的YOLO-v1模型进行的首次高分辨率FHE目标检测实验。Orion是开源的,可通过以下链接使用:https://github.com/baahl-nyu/orion

英文摘要:

Fully Homomorphic Encryption (FHE) has the potential to substantially improve privacy and security by enabling computation directly on encrypted data. This is especially true with deep learning, as today, many popular user services are powered by neural networks in the cloud. Beyond its well-known high computational costs, one of the major challenges facing wide-scale deployment of FHE-secured neural inference is effectively mapping these networks to FHE primitives. FHE poses many programming challenges including packing large vectors, managing accumulated noise, and translating arbitrary and general-purpose programs to the limited instruction set provided by FHE. These challenges make building large FHE neural networks intractable using the tools available today. In this paper we address these challenges with Orion, a fully-automated framework for private neural inference using FHE. Orion accepts deep neural networks written in PyTorch and translates them into efficient FHE programs. We achieve this by proposing a novel single-shot multiplexed packing strategy for arbitrary convolutions and through a new, efficient technique to automate bootstrap placement and scale management. We evaluate Orion on common benchmarks used by the FHE deep learning community and outperform state-of-the-art by 2.38x on ResNet-20, the largest network they report. Orion's techniques enable processing much deeper and larger networks. We demonstrate this by evaluating ResNet-50 on ImageNet and present the first high-resolution FHE object detection experiments using a YOLO-v1 model with 139 million parameters. Orion is open-source for all to use at: https://github.com/baahl-nyu/orion

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑