使用Hercule增强I/O和Exascale时代的可视化:RAMSES上的测试用例
Boosting I/O and visualization for exascale era using Hercule: test case on RAMSES
摘要:
I/O已成为制约应用扩展的瓶颈之一。新的概念,如“在途”和“原地”可视化和分析已被确定为关键技术,以规避这一特殊问题。一个新的并行I/O和数据管理库称为大力神,在CEA-DAM开发,已集成到Ramses,AMR模拟代码的自引力流体。将原始的Ramses输出格式拆分为专门用于检查点/重启(HProt格式)或后处理(HDep格式)的Hercule数据库格式,不仅提高了Ramses代码的I/O性能和可扩展性,而且还在模拟输出中引入了更多的灵活性,以帮助天体物理学家准备他们的数据管理(数据管理计划)。此外,非常轻量级和特定目的的后处理格式(HDep)将显着提高分析和可视化工具(如PyMSES 5)的整体性能。介绍了大力神并行I/O库以及I/O基准测试结果将进行讨论。
英文摘要:
It has been clearly identified that I/O is one of the bottleneck to extend application for the exascale era. New concepts such as 'in transit' and 'in situ' visualization and analysis have been identified as key technologies to circumvent this particular issue. A new parallel I/O and data management library called Hercule, developed at CEA-DAM, has been integrated to Ramses, an AMR simulation code for self-gravitating fluids. Splitting the original Ramses output format in Hercule database formats dedicated to either checkpoints/restarts (HProt format) or post-processing (HDep format) not only improved I/O performance and scalability of the Ramses code but also introduced much more flexibility in the simulation outputs to help astrophysicists prepare their DMP (Data Management Plan). Furthermore, the very lightweight and purpose-specific post-processing format (HDep) will significantly improve the overall performance of analysis and visualization tools such as PyMSES 5. An introduction to the Hercule parallel I/O library as well as I/O benchmark results will be discussed.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。