基于总拥有成本的全闪存数据中心存储系统的I/O闪存管理
I/O Workload Management for All-Flash Datacenter Storage Systems Based on Total Cost of Ownership
摘要:
近年来,基于闪存的固态驱动器(SSD)的资本支出不断下降,而SSD的存储容量不断增加。因此,全闪存存储系统对于数据中心的大型共享存储安装来说已经开始变得更加经济可行,其中总拥有成本(TCO)等指标至关重要。另一方面,闪存设备遭受写入放大,如果不考虑这一点,则会大幅增加存储系统的TCO。在本文中,我们首先为数据中心全闪存存储系统开发了一个TCO模型,然后将我们基于经验数据构建的NVMe SSD的写入放大模型(WAF)插入到该TCO模型中。我们新的WAF模型考虑了工作负载特性,如写入速率和顺序写入百分比。此外,使用TCO和WAF模型作为优化标准,我们设计了新的闪存资源管理方案(MINTCO),以指导数据中心管理员进行工作负载分配决策下的TCO考虑固态硬盘。在此基础上,我们还开发了支持RAID SSD的MINTCO-RAID和在初始化阶段优化离线工作负载磁盘部署问题的MINTCO-OFFLINE。实验结果表明,MINTCO可以降低TCO,并保持较高的吞吐量和整个数据中心存储资源的空间利用率。
英文摘要:
Recently, the capital expenditure of flash-based Solid State Driver (SSDs) keeps declining and the storage capacity of SSDs keeps increasing. As a result, all-flash storage systems have started to become more economically viable for large shared storage installations in datacenters, where metrics like Total Cost of Ownership (TCO) are of paramount importance. On the other hand, flash devices suffer from write amplification, which, if unaccounted, can substantially increase the TCO of a storage system. In this paper, we first develop a TCO model for datacenter all-flash storage systems, and then plug a Write Amplification model (WAF) of NVMe SSDs we build based on empirical data into this TCO model. Our new WAF model accounts for workload characteristics like write rate and percentage of sequential writes. Furthermore, using both the TCO and WAF models as the optimization criterion, we design new flash resource management schemes (MINTCO) to guide datacenter managers to make workload allocation decisions under the consideration of TCO for SSDs. Based on that, we also develop MINTCO-RAID to support RAID SSDs and MINTCO-OFFLINE to optimize the offline workload-disk deployment problem during the initialization phase. Experimental results show that MINTCO can reduce the TCO and keep relatively high throughput and space utilization of the entire datacenter storage resources.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。