arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2212.09096cs.DC
收藏

FileDAG:基于DAG区块链构建的多版本分散存储网络

FileDAG: A Multi-Version Decentralized Storage Network Built on DAG-based Blockchain

Hechuan Guo, Minghui Xu, Jiahao Zhang, Chunchi Liu, Dongxiao Yu, Schahram Dustdar, Xiuzhen Cheng

摘要:

分散存储网络(DSNs)可以从互不信任的提供商收集存储资源,形成全球分散的文件系统。与传统的存储网络相比,DSN建立在区块链之上,可以激励服务提供商并确保强大的安全性。然而,现有的DSN面临两大挑战。首先,重复数据删除只能在目录级别实现。缺少文件级重复数据消除会导致不可避免的额外存储和带宽成本。其次,当前的DSN通过存储额外的元数据来实现文件索引,而区块链分类账没有得到充分利用。为了克服这些问题,我们提出了FileDAG,这是一种基于DAG的区块链构建的DSN,用于支持存储多版本文件的文件级重复数据删除。在更新文件时,我们采用增量生成方法,只计算和存储增量,而不是整个更新的文件。此外,我们还引入了一个基于DAG的两层区块链分类账,通过该分类账,FileDAG可以直接使用区块链数据库提供灵活且节省存储的文件索引,而不会产生额外的存储开销。我们实现了FileDAG和评估其性能与广泛的实验。结果表明,考虑到存储成本和延迟,FileDAG优于最先进的工业DSN。

英文摘要:

Decentralized Storage Networks (DSNs) can gather storage resources from mutually untrusted providers and form worldwide decentralized file systems. Compared to traditional storage networks, DSNs are built on top of blockchains, which can incentivize service providers and ensure strong security. However, existing DSNs face two major challenges. First, deduplication can only be achieved at the directory-level. Missing file-level deduplication leads to unavoidable extra storage and bandwidth cost. Second, current DSNs realize file indexing by storing extra metadata while blockchain ledgers are not fully exploited. To overcome these problems, we propose FileDAG, a DSN built on DAG-based blockchain to support file-level deduplication in storing multi-versioned files. When updating files, we adopt an increment generation method to calculate and store only the increments instead of the entire updated files. Besides, we introduce a two-layer DAG-based blockchain ledger, by which FileDAG can provide flexible and storage-saving file indexing by directly using the blockchain database without incurring extra storage overhead. We implement FileDAG and evaluate its performance with extensive experiments. The results demonstrate that FileDAG outperforms the state-of-the-art industrial DSNs considering storage cost and latency.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑