用于并行Python编程的pPython
pPython for Parallel Python Programming
摘要:
pPython试图提供一种并行能力,通过在纯Python中基于文件的消息传递库(PythonMPI)之上实现分区全局数组语义(PGAS),在不牺牲Python编程的易用性的情况下提供良好的加速。pPython中的核心数据结构是一个分布式数值数组,它在多个处理器上的分布是用map构造指定的。分布式阵列之间的通信操作被抽象为远离用户,pPython透明地支持在多达四个维度上的任何块循环重叠分布之间的重新分配。pPython遵循SPMD(单程序多数据)计算模型。pPython可在支持Python的任何异构系统组合上运行,包括Windows、Linux和MacOS操作系统。除了在单节点上透明地运行(例如,笔记本电脑),pPython提供了一个调度器接口,这样pPython就可以在大规模并行计算环境中执行。最初的实现使用Slurm调度器。pPython在HPC Challenge基准测试套件上的性能证明了编程的简易性和可扩展性。
英文摘要:
pPython seeks to provide a parallel capability that provides good speed-up without sacrificing the ease of programming in Python by implementing partitioned global array semantics (PGAS) on top of a simple file-based messaging library (PythonMPI) in pure Python. The core data structure in pPython is a distributed numerical array whose distribution onto multiple processors is specified with a map construct. Communication operations between distributed arrays are abstracted away from the user and pPython transparently supports redistribution between any block-cyclic-overlapped distributions in up to four dimensions. pPython follows a SPMD (single program multiple data) model of computation. pPython runs on any combination of heterogeneous systems that support Python, including Windows, Linux, and MacOS operating systems. In addition to running transparently on single-node (e.g., a laptop), pPython provides a scheduler interface, so that pPython can be executed in a massively parallel computing environment. The initial implementation uses the Slurm scheduler. Performance of pPython on the HPC Challenge benchmark suite demonstrates both ease of programming and scalability.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。