arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 0908.2984cs.ITmath.IT
收藏

最小化分布式存储修复带宽的显式编码

Explicit Codes Minimizing Repair Bandwidth for Distributed Storage

Nihar B. Shah, K. V. Rashmi, P. Vijay Kumar, Kannan Ramchandran

摘要:

我们考虑以分布式方式跨n个节点设置数据存储。数据收集器(DC)应该能够通过连接到n个节点中的任何k个节点并下载存储在其中的所有数据来重建整个数据。当一个节点出现故障时,必须使用现有节点重新生成它。在最近的一篇论文中,Wu等人得到了修复带宽的信息论下界。此外,还对以系统形式存储数据产生了额外的兴趣,因为当DC连接到k个系统节点时不需要后处理。由于它们的首选状态,需要快速准确地重新生成任何系统节点。用精确的副本替换失效节点称为精确再生,本文考虑了系统节点精确再生时的修复带宽最小化问题。要存储的文件大小为B,每个节点可以存储alpha = B/k个数据单元。通过从d个现有节点下载beta单元的数据来重新生成故障系统节点。我们给出了一个下界的修复带宽的系统节点的确切再生,它与吴等人给出的界限相匹配。对于d >= 2k-1,我们给出了一个显式的代码建设,最大限度地减少修复带宽时,现有的k-1系统节点参与再生。我们展示了实现d >= 2k-3的界的代码的存在性和构造。在这里,我们还建立了干涉对齐的必要性。我们证明了当beta=1时,d <= 2k-4的上界是不可达到的。我们还给出了一个编码方案,可用于任何d和k,这是最佳的d >= 2k-1。

英文摘要:

We consider the setting of data storage across n nodes in a distributed manner. A data collector (DC) should be able to reconstruct the entire data by connecting to any k out of the n nodes and downloading all the data stored in them. When a node fails, it has to be regenerated back using the existing nodes. In a recent paper, Wu et al. have obtained an information theoretic lower bound for the repair bandwidth. Also, there has been additional interest in storing data in systematic form as no post processing is required when DC connects to k systematic nodes. Because of their preferred status there is a need to regenerate back any systematic node quickly and exactly. Replacement of a failed node by an exact replica is termed Exact Regeneration.In this paper, we consider the problem of minimizing the repair bandwidth for exact regeneration of the systematic nodes. The file to be stored is of size B and each node can store alpha = B/k units of data. A failed systematic node is regenerated by downloading beta units of data each from d existing nodes. We give a lower bound for the repair bandwidth for exact regeneration of the systematic nodes which matches with the bound given by Wu et al. For d >= 2k-1 we give an explicit code construction which minimizes the repair bandwidth when the existing k-1 systematic nodes participate in the regeneration. We show the existence and construction of codes that achieve the bound for d >= 2k-3. Here we also establish the necessity of interference alignment. We prove that the bound is not achievable for d <= 2k-4 when beta=1. We also give a coding scheme which can be used for any d and k, which is optimal for d >= 2k-1.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑