arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2007.12934cs.CRcs.LGstat.ML
收藏

SOTERIA:寻找用于私人推理的高效神经网络

SOTERIA: In Search of Efficient Neural Networks for Private Inference

National University of Singapore(新加坡国立大学);Microsoft Research(微软研究院)

Anshul Aggarwal, Trevor E. Carlson, Reza Shokri, Shruti Tople

摘要:

ML即服务越来越受欢迎,其中云服务器托管训练模型并向用户提供预测(推理)服务。在这种情况下,我们的目标是保护用户的输入查询以及在服务器上的模型参数的机密性,具有适度的计算和通信开销。现有的解决方案主要提出微调加密方法,以使它们对已知的固定模型架构有效。这种方法的缺点是,模型本身从来没有被设计为与现有的有效加密计算一起操作。我们观察到,在训练过程中选择的模型的网络架构、内部函数和参数,在推理过程中会显著影响加密方法的计算和通信开销。基于这一观察,我们提出了SOTERIA -一种训练方法来构建模型架构,这种架构对于私有推理来说是设计有效的。我们使用神经架构搜索算法的双重目标,优化模型的准确性和使用密码原语进行安全推理的开销。考虑到在训练过程中修改模型的灵活性,我们找到了对私有计算也有效的精确模型。我们选择乱码电路作为我们的底层加密原语,由于他们的表现力和效率,但这种方法可以扩展到混合多方计算设置。我们在MNIST和CIFAR 10数据集上对SOTERIA进行了经验评估,并与之前的工作进行了比较。我们的结果证实了SOTERIA在平衡性能和准确性方面确实有效。

英文摘要:

ML-as-a-service is gaining popularity where a cloud server hosts a trained model and offers prediction (inference) service to users. In this setting, our objective is to protect the confidentiality of both the users' input queries as well as the model parameters at the server, with modest computation and communication overhead. Prior solutions primarily propose fine-tuning cryptographic methods to make them efficient for known fixed model architectures. The drawback with this line of approach is that the model itself is never designed to operate with existing efficient cryptographic computations. We observe that the network architecture, internal functions, and parameters of a model, which are all chosen during training, significantly influence the computation and communication overhead of a cryptographic method, during inference. Based on this observation, we propose SOTERIA -- a training method to construct model architectures that are by-design efficient for private inference. We use neural architecture search algorithms with the dual objective of optimizing the accuracy of the model and the overhead of using cryptographic primitives for secure inference. Given the flexibility of modifying a model during training, we find accurate models that are also efficient for private computation. We select garbled circuits as our underlying cryptographic primitive, due to their expressiveness and efficiency, but this approach can be extended to hybrid multi-party computation settings. We empirically evaluate SOTERIA on MNIST and CIFAR10 datasets, to compare with the prior work. Our results confirm that SOTERIA is indeed effective in balancing performance and accuracy.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑