通过建模与仿真表征HPC应用的I/O行为
Characterizing the I/O Behavior of HPC Applications through Modeling and Simulation
浏览论文内容
中文总结 AI 辅助
本研究开发了基于ElastiSim的框架，结合HPCIO追踪复现真实HPC应用I/O访问模式，通过案例分析实现I/O拥塞分析，以表征HPC应用I/O行为。
中文摘要 AI 辅助
并行应用会处理大量数据，导致产生密集的并行I/O操作。这些操作可呈现不同复杂度，包括多种I/O访问模式、数据暂存、竞争风险等。因此，为高效利用高性能计算（HPC）系统并优化I/O性能，考虑HPC应用的I/O行为至关重要。本研究开发了一个框架，可在ElastiSim（支持刚性、可塑及演进工作负载的批处理系统模拟器）提供的模拟环境中复现真实应用的I/O访问模式。模拟应用基于HPC输入/输出分析库（HPCIO）提供的真实应用I/O追踪生成。HPCIO分析数据库包含追踪数据，以及不同并行I/O库和I/O栈各层的真实应用性能信息。我们对真实应用的追踪开展了详细案例研究，以证明所提建模框架如何为I/O应用的性能特征提供洞见，包括基于应用I/O访问模式的I/O拥塞分析。
英文摘要
Parallel applications process large amounts of data, leading to intensive parallel I/O operations. These operations can exhibit different levels of complexity, including, among others, multiple I/O access patterns, data staging, and contention risks. Therefore, in order to exploit high-performance computing (HPC) systems efficiently and optimize the I/O performance, it is crucial to consider the I/O behaviour of the HPC applications. In this work, we have developed a framework that reproduces the I/O access pattern of real applications in a simulated environment provided by ElastiSim, a batch-system simulator for rigid, malleable, and evolving workloads. The simulated applications are generated based on I/O traces captured from real applications provided by the HPC Input/Output (HPCIO) analysis repository. The HPCIO analysis database includes traces combined with information about real applications' performance across different parallel I/O libraries and layers of the I/O stack. We have conducted detailed case studies of real-world applications' traces to demonstrate how the proposed modeling framework can provide insights into the performance characteristics of I/O applications, including the I/O congestion analysis based on the application's I/O access pattern.
