arXivDaily arXiv每日学术速递 周一至周五更新
arXiv cs/0207096cs.DC
收藏

不连续的I/O到PVFS

Noncontiguous I/O through PVFS

Avery Ching, Alok Choudhary, Wei-keng Liao, Rob Ross, William Gropp

摘要:

随着处理器和存储器技术的巨大进步,I/O已经成为许多应用程序高性能计算的瓶颈。并行文件系统的开发有助于缓解性能差距,但I/O仍然是一个需要显著提高性能的领域。研究发现,科学应用程序中的非连续I/O访问模式与当前执行这些访问的文件系统方法相结合,导致大型数据集的性能无法接受。为了提高非连续I/O的性能,我们创建了列表I/O,这是非连续I/O的本机版本。我们使用并行虚拟文件系统(PVFS)来实现我们的想法。我们的研究和实验表明,列表I/O优于目前的非连续I/O访问方法在大多数I/O的情况下,可以大大提高现实世界的科学应用程序的性能。

英文摘要:

With the tremendous advances in processor and memory technology, I/O has risen to become the bottleneck in high-performance computing for many applications. The development of parallel file systems has helped to ease the performance gap, but I/O still remains an area needing significant performance improvement. Research has found that noncontiguous I/O access patterns in scientific applications combined with current file system methods to perform these accesses lead to unacceptable performance for large data sets. To enhance performance of noncontiguous I/O we have created list I/O, a native version of noncontiguous I/O. We have used the Parallel Virtual File System (PVFS) to implement our ideas. Our research and experimentation shows that list I/O outperforms current noncontiguous I/O access methods in most I/O situations and can substantially enhance the performance of real-world scientific applications.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑