Julia Cloud Matrix Machine:云上多核集群中的动态矩阵语言加速
Julia Cloud Matrix Machine: Dynamic Matrix Language Acceleration on Multicore Clusters in the Cloud
AI总结:
本文扩展 Julia,利用有向图、惰性求值、动态仿真和自动进程配置实现云上矩阵计算的自动并行与扩展,在 AWS 564 CPU 集群上最高获得 5.1 倍加速。
摘要:
在新兴的科学计算环境中,规模和复杂度不断增长的矩阵计算正变得日益普遍。然而,当代矩阵语言实现在高效利用云计算资源方面支持不足,尤其是在用户侧。因此,我们开发了 Julia 高性能计算语言的一个扩展,使矩阵计算能够在云中自动并行化,用户无需直接与复杂的显式并行计算交互。我们实现了惰性求值语义,并结合有向图来即时优化矩阵操作;同时,动态仿真会为给定的云节点集群寻找最优分块大小和调度。为支持这些仿真,我们构建了关于集群性能容量的时间模型预测。云网络中通信进程和工作进程的自动配置使该框架能够针对异构节点集群自动扩展。我们框架的实验评估包括在 AWS 公有云上一个 14 节点(564 个 CPU)集群中运行的 11 个基准测试,结果显示加速比最高达到 5.1 倍,平均达到加速比上界的 74.39%。
英文摘要:
In emerging scientific computing environments, matrix computations of increasing size and complexity are increasingly becoming prevalent. However, contemporary matrix language implementations are insufficient in their support for efficient utilization of cloud computing resources, particularly on the user side. We thus developed an extension of the Julia high-performance computation language such that matrix computations are automatically parallelized in the cloud, where users are separated from directly interacting with complex explicitly-parallel computations. We implement lazy evaluation semantics combined with directed graphs to optimize matrix operations on the fly while dynamic simulation finds the optimal tile size and schedule for a given cluster of cloud nodes. A time model prediction of the cluster's performance capacity is constructed to enable simulations. Automatic configuration of communication and worker processes on the cloud networks allow for the framework to automatically scale up for clusters of heterogeneous nodes. Our framework's experimental evaluation comprises eleven benchmarks on an fourteen node (564 CPUs) cluster in the AWS public cloud, revealing speedups of up to a factor of 5.1, with an average 74.39% of the upper bound for speedups.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。