支持RDMA的基于InfiniBand的PDKEEPAAA协议的设计与实现
Design and Implementation of MPICH2 over InfiniBand with RDMA Support
摘要:
几年来,MPI一直是编写并行应用程序的事实标准。最流行的MPI实现之一是MPICH。它的继任者MPICH 2采用了全新的设计,提供了更高的性能和灵活性。为了确保可移植性,它有一个层次结构,基于这个结构,可以在不同的级别上进行移植。在本文中,我们提出了我们的经验,设计和实现MPICH 2在InfiniBand。由于其高性能和开放标准,InfiniBand在高性能计算领域越来越受欢迎。我们的研究重点是优化MPICH 2中MPI-1函数的性能。我们的目标之一是利用远程直接内存访问(RDMA)在Infiniband实现高性能。我们的设计基于MPICH 2提供的RDMA通道接口,该接口将依赖于架构的通信功能封装到一组非常小的功能中。从一个基本的设计开始,我们应用不同的优化,并提出了一个基于零拷贝的设计。我们使用微基准来描述我们的优化和设计的影响。我们还使用NAS并行基准测试执行了应用程序级评估。我们优化的MPICH 2实现实现了7.6 $μ$ s的延迟和857 MB/s的带宽,接近底层InfiniBand层的原始性能。我们的研究表明,在MPICH 2中的RDMA通道接口提供了一个简单的,但功能强大的,抽象,使实现具有高性能的利用RDMA操作在InfiniBand。据我们所知,这是第一个使用RDMA支持的InfiniBand上MPICH 2的高性能设计和实现。
英文摘要:
For several years, MPI has been the de facto standard for writing parallel applications. One of the most popular MPI implementations is MPICH. Its successor, MPICH2, features a completely new design that provides more performance and flexibility. To ensure portability, it has a hierarchical structure based on which porting can be done at different levels. In this paper, we present our experiences designing and implementing MPICH2 over InfiniBand. Because of its high performance and open standard, InfiniBand is gaining popularity in the area of high-performance computing. Our study focuses on optimizing the performance of MPI-1 functions in MPICH2. One of our objectives is to exploit Remote Direct Memory Access (RDMA) in Infiniband to achieve high performance. We have based our design on the RDMA Channel interface provided by MPICH2, which encapsulates architecture-dependent communication functionalities into a very small set of functions. Starting with a basic design, we apply different optimizations and also propose a zero-copy-based design. We characterize the impact of our optimizations and designs using microbenchmarks. We have also performed an application-level evaluation using the NAS Parallel Benchmarks. Our optimized MPICH2 implementation achieves 7.6 $μ$s latency and 857 MB/s bandwidth, which are close to the raw performance of the underlying InfiniBand layer. Our study shows that the RDMA Channel interface in MPICH2 provides a simple, yet powerful, abstraction that enables implementations with high performance by exploiting RDMA operations in InfiniBand. To the best of our knowledge, this is the first high-performance design and implementation of MPICH2 on InfiniBand using RDMA support.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。