arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1807.02562cs.DC
收藏

使用大规模对象存储探索科学应用性能

Exploring Scientific Application Performance Using Large Scale Object Storage

Steven Wei-der Chien, Stefano Markidis, Rami Karim, Erwin Laure, Sai Narasimhamurthy

摘要:

大型科学应用中的主要性能和可扩展性瓶颈之一是对超级计算机I/O系统的并行读取和写入。并行文件系统的使用和POSIX的一致性要求,所有传统的HPC并行I/O接口坚持,对科学应用程序的可伸缩性造成限制。对象存储是云计算中广泛使用的存储技术,并且更频繁地被提议用于HPC工作负载,以解决和改进科学应用中I/O的当前可扩展性和性能。虽然对象存储是一项很有前途的技术,但目前还不清楚科学应用将如何使用对象存储以及主要的性能优势是什么。这项工作通过模拟传统科学应用程序使用的对象存储并评估潜在的性能优势来解决这些问题。我们表明,科学应用程序可以受益于大规模使用对象存储。

英文摘要:

One of the major performance and scalability bottlenecks in large scientific applications is parallel reading and writing to supercomputer I/O systems. The usage of parallel file systems and consistency requirements of POSIX, that all the traditional HPC parallel I/O interfaces adhere to, pose limitations to the scalability of scientific applications. Object storage is a widely used storage technology in cloud computing and is more frequently proposed for HPC workload to address and improve the current scalability and performance of I/O in scientific applications. While object storage is a promising technology, it is still unclear how scientific applications will use object storage and what the main performance benefits will be. This work addresses these questions, by emulating an object storage used by a traditional scientific application and evaluating potential performance benefits. We show that scientific applications can benefit from the usage of object storage on large scales.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑