arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1801.04686cs.DCcs.ITmath.IT
收藏

面向分布式计算的分层编码

Hierarchical Coding for Distributed Computing

Hyegyeong Park, Kangwook Lee, Jy-yong Sohn, Changho Suh, Jaekyun Moon

摘要:

为分布式计算编码通过减轻分散工作人员的负担来支持低延迟计算。虽然大多数现有的作品假设一个简单的主-工人模型,我们认为一个层次化的计算结构,由工人组,动机是需要反映现实世界的分布式计算系统的架构。在这项工作中,我们提出了一个分层编码方案,该模型,以及分析其解码成本和预期的计算时间。具体来说,我们首先提供上界和下界所提出的计划的预期计算时间。我们还表明,我们的计划,使高效的并行解码,从而降低解码成本的数量级超过非层次的计划。当同时考虑解码成本和计算时间时,所提出的分层编码在许多实际场景中表现出优于现有方案。

英文摘要:

Coding for distributed computing supports low-latency computation by relieving the burden of straggling workers. While most existing works assume a simple master-worker model, we consider a hierarchical computational structure consisting of groups of workers, motivated by the need to reflect the architectures of real-world distributed computing systems. In this work, we propose a hierarchical coding scheme for this model, as well as analyze its decoding cost and expected computation time. Specifically, we first provide upper and lower bounds on the expected computing time of the proposed scheme. We also show that our scheme enables efficient parallel decoding, thus reducing decoding costs by orders of magnitude over non-hierarchical schemes. When considering both decoding cost and computing time, the proposed hierarchical coding is shown to outperform existing schemes in many practical scenarios.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑