arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1707.00904cs.DCcs.DBcs.DS
收藏

Sequential Checking:面向横向扩展存储的免重分配数据分发算法

Sequential Checking: Reallocation-Free Data-Distribution Algorithm for Scale-out Storage

Ken-ichiro Ishikawa

摘要:

使用磁带或光学设备进行横向扩展存储是存储大量数据的一种选择。然而,用这样的设备重写数据是不可能或几乎不可能的。因此,使用这样的设备的横向扩展存储不能使用标准数据分布算法,因为当服务器配置改变时,它们重写用于在构成横向扩展存储的服务器之间移动的数据。虽然采用了可扩展存储设备进行横向扩展存储,但当服务器容量很大时,当服务器结构改变时,重写数据是非常困难的。本文提出了一种称为顺序检查的数据分发算法,该算法可用于由难以重写数据的设备组成的横向扩展存储。顺序检查1)当服务器配置改变时不需要在服务器之间移动数据,2)分发数据,其量取决于服务器的容量,3)当写入数据时选择唯一的服务器,以及4)当读取数据时选择服务器(在大多数情况下很少有这样的服务器)并从它们中找到存储最新数据的唯一服务器。这些基本特性通过证明和仿真得到了证实。在现实条件下,从包括256个服务器的存储中平均访问1.98个服务器可以读取数据。通过在实际环境中的评估,证实了访问时间是可以接受的。顺序检查使选择使用磁带或光盘设备或使用大容量服务器的横向扩展存储成为现实。

英文摘要:

Using tape or optical devices for scale-out storage is one option for storing a vast amount of data. However, it is impossible or almost impossible to rewrite data with such devices. Thus, scale-out storage using such devices cannot use standard data-distribution algorithms because they rewrite data for moving between servers constituting the scale-out storage when the server configuration is changed. Although using rewritable devices for scale-out storage, when server capacity is huge, rewriting data is very hard when server constitution is changed. In this paper, a data-distribution algorithm called Sequential Checking is proposed, which can be used for scale-out storage composed of devices that are hardly able to rewrite data. Sequential Checking 1) does not need to move data between servers when the server configuration is changed, 2) distribute data, the amount of which depends on the server's volume, 3) select a unique server when datum is written, and 4) select servers when datum is read (there are few such server(s) in most cases) and find out a unique server that stores the newest datum from them. These basic characteristics were confirmed through proofs and simulations. Data can be read by accessing 1.98 servers on average from a storage comprising 256 servers under a realistic condition. And it is confirmed by evaluations in real environment that access time is acceptable. Sequential Checking makes selecting scale-out storage using tape or optical devices or using huge capacity servers realistic.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑