近似免费的优先级队列跳转用于私有神经推断的先验输入
Almost-Free Queue Jumping for Prior Inputs in Private Neural Inference
AI总结:
本文提出PrivQJ框架,通过共享计算实现高效优先级处理,减少加密开销,显著提升批量推断效率。
摘要:
隐私保护机器学习即服务(PP-MLaaS)通过整合同态加密(HE)和多方计算(MPC)等密码原语,实现安全的神经网络推断,保护客户端数据和服务器模型。近期混合原语框架显著提高了推断效率,但处理批量输入顺序性较低,难以优先处理紧急请求。朴素的队列跳转引入显著的计算和通信开销,增加队列中输入的非可忽略延迟。本文首次研究隐私保护队列跳转在批量推断中的应用,提出PrivQJ框架,通过输入处理槽位复用实现高效优先级处理,无需降低整体系统性能。理论分析和实验结果表明,与现有PP-MLaaS系统相比,开销减少了一个数量级。
英文摘要:
Privacy-Preserving Machine Learning as a Service (PP-MLaaS) enables secure neural network inference by integrating cryptographic primitives such as homomorphic encryption (HE) and multi-party computation (MPC), protecting both client data and server models. Recent mixed-primitive frameworks have significantly improved inference efficiency, yet they process batched inputs sequentially, offering little flexibility for prioritizing urgent requests. Naïve queue jumping introduces considerable computational and communication overhead, increasing non-negligible latency for in-queue inputs. We initiate the study of privacy-preserving queue jumping in batched inference and propose PrivQJ, a novel framework that enables efficient priority handling without degrading overall system performance. PrivQJ exploits shared computation across inputs via in-processing slot recycling, allowing prior inputs to be piggybacked onto ongoing batch computation with almost no additional cryptographic cost. Both theoretical analysis and experimental results demonstrate over an order-of-magnitude reduction in overhead compared to state-of-the-art PP-MLaaS systems.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。