ViPIOS -维也纳并行输入输出系统：并行I/O操作的语言、编译器和高级数据结构支持
ViPIOS - VIenna Parallel Input Output System: Language, Compiler and Advanced Data Structure Support for Parallel I/O Operations
摘要：
对于越来越多的数据密集型科学应用程序，并行I/O概念是一个主要的性能问题。针对这个问题，我们开发了一个输入/输出系统，设计高效，可扩展和方便使用的并行I/O分布式存储系统。本研究的主要重点是并行I/O运行时系统的支持，提供了软件生成的程序，并行编译器的背景下，高性能FORTRAN的努力。具体来说，我们的设计目标是维也纳Fortran编译系统。在我们的研究项目中，我们调查的I/O问题，从运行时系统支持的角度来看。我们专注于设计一个先进的并行I/O支持，称为VIPIOS（维也纳并行I/O系统），有针对性的语言编译器支持相同的编程模型，如高性能Fortran（HPF）。ViPIOS的设计部分受到并行数据库技术概念的影响。在项目开始时，我们开发了一个正式的模型，它形成了一个理论框架，ViPIOS设计的基础。该模型描述了从应用程序数据结构开始到磁盘上的物理布局的问题特定数据空间的映射，该映射跨越几个中间表示级别。基于这个形式化模型，我们设计并开发了一个I/O运行时系统ViPIOS，它提供了对几个问题的支持，如：并行访问文件进行读/写操作，优化磁盘上的数据布局，重新分配存储在磁盘上的数据，核心外（OOC）数据的通信，以及许多优化，包括基于由编译器从程序提取的或由用户规范提供的访问模式知识从盘预取数据。
英文摘要：
For an increasing number of data intensive scientific applications, parallel I/O concepts are a major performance issue. Tackling this issue, we develop an input/output system designed for highly efficient, scalable and conveniently usable parallel I/O on distributed memory systems. The main focus of this research is the parallel I/O runtime system support provided for software-generated programs produced by parallelizing compilers in the context of High Performance FORTRAN efforts. Specifically, our design aims for the Vienna Fortran Compilation System. In our research project we investigate the I/O problem from a runtime system support perspective. We focus on the design of an advanced parallel I/O support, called ViPIOS (VIenna Parallel I/O System), to be targeted by language compilers supporting the same programming model like High Performance Fortran (HPF). The ViPIOS design is partly influenced by the concepts of parallel database technology. At the beginning of the project we developed a formal model, which forms a theoretical framework on which the ViPIOS design is based. This model describes the mapping of the problem specific data space starting from the application program data structures down to the physical layout on disk across several intermediate representation levels. Based on this formal model we designed and developed an I/O runtime system, ViPIOS, which provides support for several issues, as - parallel access to files for read/write operations, - optimization of data-layout on disks, - redistribution of data stored on disks, - communication of out-of-core (OOC) data, and - many optimizations including data prefetching from disks based on the access pattern knowledge extracted from the program by the compiler or provided by a user specification.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
