arXivDaily arXiv每日学术速递 周一至周五更新
北美退伍军人节(Veterans Day),12 日无更新
arXiv 2004.10033cs.DC
收藏

共享存储器HPC中无等待协调算法的相关性:全局虚拟时间情形

On the Relevance of Wait-free Coordination Algorithms in Shared-Memory HPC:The Global Virtual Time Case

Alessandro Pellegrini, Francesco Quaglia

摘要:

共享存储器/多核架构上的高性能计算可能由于协调算法而遭受不可忽略的性能瓶颈,然而协调算法对于确保总体正确性和/或支持内务操作的执行(例如,恢复计算资源(例如,内存)。虽然在设计/开发上更加复杂,但是从经典协调算法到无等待算法的范式切换可以显著提高HPC应用程序的性能。在本文中,我们探讨了这种模式的转变在共享内存架构的相关性,通过集中在并行离散事件仿真的背景下,其中的全球虚拟时间(GVT)代表一个基本的协调算法。它允许计算参与并行/分布式计算的所有实体通过的逻辑时间值的下限。因此,它可以用来区分哪些事件属于计算的过去历史-从而被认为是提交的-并允许内存恢复(例如,为了支持状态可恢复性而采取的过时日志)和不可撤销的操作(例如I/O)。我们比较的参考(阻塞)算法共享内存,一个由藤本和Hybinette \cite{Fuj97},提出了一个创新的无等待的实现,强调什么设计选择必须执行这种范式转变,以及什么是协调算法中删除关键部分的性能影响。

英文摘要:

High-performance computing on shared-memory/multi-core architectures could suffer from non-negligible performance bottlenecks due to coordination algorithms, which are nevertheless necessary to ensure the overall correctness and/or to support the execution of housekeeping operations, e.g. to recover computing resources (e.g., memory). Although more complex in design/development, a paradigm switch from classical coordination algorithms to wait-free ones could significantly boost the performance of HPC applications. In this paper we explore the relevance of this paradigm shift in shared-memory architectures, by focusing on the context of Parallel Discrete Event Simulation, where the Global Virtual Time (GVT) represents a fundamental coordination algorithm. It allows to compute the lower bound on the value of the logical time passed through by all the entities participating in a parallel/distributed computation. Hence it can be used to discriminate what events belong to the past history of the computation---thus being considered as committed---and allowing for memory recovery (e.g. of obsolete logs that were taken in order to support state recoverability) and non-revokable operations (e.g. I/O). We compare the reference (blocking) algorithm for shared memory, the one proposed by by Fujimoto and Hybinette \cite{Fuj97}, with an innovative wait-free implementation, emphasizing on what design choices must be made to enforce this paradigm shift, and what are the performance implications of removing critical sections in coordination algorithms.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑