arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1902.05746cs.DC
收藏

利用流量检测优化SSD突发缓冲区

Optimizing the SSD Burst Buffer by Traffic Detection

Xuanhua Shi, Wei Liu, Ligang He, Hai Jin, Ming Li, Yong Chen

摘要:

目前,已经提出了突发缓冲区来管理突发写入请求的SSD缓冲。虽然突发缓冲区可以提高I/O性能,在许多情况下,我们发现它有一些限制,如需要大SSD容量和和谐的计算阶段和数据刷新阶段之间的重叠。在本文中,我们提出了一个方案,称为SSDUP+1。SSDUP+旨在通过解决上述限制来改进突发缓冲区。首先,为了减少对SSD容量的需求,我们开发了一种新的方法来检测和量化写入流量中的数据随机性。此外,提出了一种自适应算法来动态地对随机写入进行分类。通过这样做,需要更少的SSD容量来实现与其他突发缓冲器方案类似的性能。接下来,为了克服计算阶段和刷新阶段完美重叠的困难,我们提出了一种用于SSD缓冲器的流水线机制,其中数据缓冲和刷新在流水线中执行。此外,为了提高I/O吞吐量,我们采用了一种流量感知的刷新策略,以减少硬盘中的I/O干扰。最后,为了进一步提高SSD中随机写入的缓冲性能,SSDUP+通过使用日志结构存储数据,将随机写入转换为SSD中的顺序写入。此外,SSDUP+使用AVL树结构来存储数据的序列信息。我们已经实现了基于OrangeFS的SSDUP+原型,并进行了广泛的实验。实验结果表明,我们提出的SSDUP+可以节省平均50%的SSD空间,而提供几乎相同的性能,其他常见的突发缓冲区计划。此外,SSDUP+与本作品的前一版本SSDUP相比,可以节省约20%的SSD空间,同时实现比SSDUP高20%-30%的I/O吞吐量。

英文摘要:

Currently, Burst buffer has been proposed to manage the SSD buffering of bursty write requests. Although burst buffer can improve I/O performance in many cases, we find that it has some limitations such as requiring large SSD capacity and harmonious overlapping between computation phase and data flushing phase. In this paper, we propose a scheme, called SSDUP+1. SSDUP+ aims to improve the burst buffer by addressing the above limitations. First, in order to reduce the demand for the SSD capacity, we develop a novel method to detect and quantify the data randomness in the write traffic. Further, an adaptive algorithm is proposed to classify the random writes dynamically. By doing so, much less SSD capacity is required to achieve the similar performance as other burst buffer schemes. Next, in order to overcome the difficulty of perfectly overlapping the computation phase and the flushing phase, we propose a pipeline mechanism for the SSD buffer, in which data buffering and flushing are performed in pipeline. In addition, in order to improve the I/O throughput, we adopt a traffic-aware flushing strategy to reduce the I/O interference in HDD. Finally, in order to further improve the performance of buffering random writes in SSD, SSDUP+ transforms the random writes to sequential writes in SSD by storing the data with a log structure. Further, SSDUP+ uses the AVL tree structure to store the sequence information of the data. We have implemented a prototype of SSDUP+ based on OrangeFS and conducted extensive experiments. The experimental results show that our proposed SSDUP+ can save an average of 50% SSD space, while delivering almost the same performance as other common burst buffer schemes. In addition, SSDUP+ can save about 20% SSD space compared with the previous version of this work, SSDUP, while achieving 20%-30% higher I/O throughput than SSDUP.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑