arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2002.09560cs.CRcs.DC
收藏

基于部分重执行的MapReduce计算完整性验证

Practical Verification of MapReduce Computation Integrity via Partial Re-execution

Eunjung Yoon, Peng Liu

摘要:

大数据处理通常外包给强大但不受信任的云服务提供商,这些云服务提供商为较弱的客户提供敏捷和可扩展的计算资源。然而,不受信任的云服务无法确保数据和计算的完整性,而客户端无法控制外包计算或无法检查执行的正确性。尽管人们对可验证计算的兴趣越来越大,并且最近取得了进展,但由于高验证开销,现有技术仍然不足以用于大数据处理。在本文中,我们提出了一个解决方案,称为V-MR(可验证MapReduce),这是一个框架,通过部分重新执行来验证在不可信云中外包的MapReduce计算的完整性。V-MR实际上是有效和高效的,因为(1)它可以检测MapReduce计算完整性的违反,并识别产生错误计算的恶意工作者。(2)它可以通过使用程序分析用仔细选择的输入数据和程序代码部分地重新执行来减少验证的开销。原型系统的实验结果表明,V-MR能够有效地验证MapReduce计算的完整性,且部分重执行开销较小。

英文摘要:

Big data processing is often outsourced to powerful, but untrusted cloud service providers that provide agile and scalable computing resources to weaker clients. However, untrusted cloud services do not ensure the integrity of data and computations while clients have no control over the outsourced computation or no means to check the correctness of the execution. Despite a growing interest and recent progress in verifiable computation, the existing techniques are still not practical enough for big data processing due to high verification overhead. In this paper, we present a solution called V-MR (Verifiable MapReduce), which is a framework that verifies the integrity of MapReduce computation outsourced in the untrusted cloud via partial re-execution. V-MR is practically effective and efficient in that (1) it can detect the violation of MapReduce computation integrity and identify the malicious workers involved in the that produced the incorrect computation. (2) it can reduce the overhead of verification via partial re-execution with carefully selected input data and program code using program analysis. The experiment results of a prototype of V-MR show that V-MR can verify the integrity of MapReduce computation effectively with small overhead for partial re-execution.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑