大型对象存储库中的碎片
Fragmentation in Large Object Repositories
摘要:
碎片会导致不可预测的应用程序性能下降。虽然这些问题已经详细研究了桌面文件系统的工作负载,这项研究探讨了新的系统,如可扩展的对象存储和多媒体存储库。这样的系统使用get/put接口来存储对象。原则上,数据库和文件系统可以有效地支持这样的应用程序,使系统设计人员能够专注于复杂性,部署成本和可扩展性。虽然理论工作证明某些存储策略对于某些工作负载表现最佳,但这些策略在实践中通常表现不佳。大多数存储基准测试侧重于短期行为或不测量碎片。我们比较了SQL Server和SQL Server,发现当对象大小超过256 KB-1 MB时,碎片将主导性能。SQL Server比SQL Server更好地处理碎片。尽管性能曲线会因其他系统和工作负载而异,但我们预计碎片和可用空间之间的相互作用也会相同。众所周知,碎片与可用空间的百分比有关。我们发现,自由空间与对象大小的比例也会影响性能。令人惊讶的是,在这两个系统中,存储单一大小的对象会导致碎片,而更改写入请求的大小会影响碎片。这些问题可以通过对文件系统和数据库接口的简单更改来解决。我们希望,对碎片化的更好理解将导致可预测的存储系统,在部署后需要更少的维护。
英文摘要:
Fragmentation leads to unpredictable and degraded application performance. While these problems have been studied in detail for desktop filesystem workloads, this study examines newer systems such as scalable object stores and multimedia repositories. Such systems use a get/put interface to store objects. In principle, databases and filesystems can support such applications efficiently, allowing system designers to focus on complexity, deployment cost and manageability. Although theoretical work proves that certain storage policies behave optimally for some workloads, these policies often behave poorly in practice. Most storage benchmarks focus on short-term behavior or do not measure fragmentation. We compare SQL Server to NTFS and find that fragmentation dominates performance when object sizes exceed 256KB-1MB. NTFS handles fragmentation better than SQL Server. Although the performance curves will vary with other systems and workloads, we expect the same interactions between fragmentation and free space to apply. It is well-known that fragmentation is related to the percentage free space. We found that the ratio of free space to object size also impacts performance. Surprisingly, in both systems, storing objects of a single size causes fragmentation, and changing the size of write requests affects fragmentation. These problems could be addressed with simple changes to the filesystem and database interfaces. It is our hope that an improved understanding of fragmentation will lead to predictable storage systems that require less maintenance after deployment.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。