clusterNOR:一个基于NUMA的优化聚类框架
clusterNOR: A NUMA-Optimized Clustering Framework
摘要:
聚类算法是迭代的,具有复杂的数据访问模式,导致许多小的随机内存访问。并行实现的性能受到每次迭代的同步障碍和倾斜工作负载的影响。我们重新考虑现代非统一内存架构(NUMA)的集群并行化,以最大限度地提高独立、异步计算的效率。我们消除了许多障碍,减少了远程内存访问,并最大限度地提高缓存重用。我们实现了“集群NUMA优化的并行”(clusterNOR)可扩展的并行框架,提供算法构建块。该系统是通用的,我们演示了九个现代聚类算法,有简单的实现。clusterNOR包括(i)存储器内,(ii)半外部存储器,以及(iii)分布式存储器执行,使得能够针对变化的存储器和硬件预算进行计算。对于依赖于欧氏距离的算法,clusterNOR定义了一个更新的Elkan三角不等式修剪算法,该算法使用的内存逐渐减少,因此可以在十亿点数据集上工作。clusterNOR通过概括基本原理、提供统一的编程接口并将范围扩展到分层和线性代数类算法,扩展并扩展了k-means聚类的“knor”库的范围。我们优化的复合效果是速度比其他最先进的解决方案(如Spark的MLlib和Apple的Turi)提高了一个数量级。
英文摘要:
Clustering algorithms are iterative and have complex data access patterns that result in many small random memory accesses. The performance of parallel implementations suffer from synchronous barriers for each iteration and skewed workloads. We rethink the parallelization of clustering for modern non-uniform memory architectures (NUMA) to maximizes independent, asynchronous computation. We eliminate many barriers, reduce remote memory accesses, and maximize cache reuse. We implement the 'Clustering NUMA Optimized Routines' (clusterNOR) extensible parallel framework that provides algorithmic building blocks. The system is generic, we demonstrate nine modern clustering algorithms that have simple implementations. clusterNOR includes (i) in-memory, (ii) semi-external memory, and (iii) distributed memory execution, enabling computation for varying memory and hardware budgets. For algorithms that rely on Euclidean distance, clusterNOR defines an updated Elkan's triangle inequality pruning algorithm that uses asymptotically less memory so that it works on billion-point data sets. clusterNOR extends and expands the scope of the 'knor' library for k-means clustering by generalizing underlying principles, providing a uniform programming interface and expanding the scope to hierarchical and linear algebraic classes of algorithms. The compound effect of our optimizations is an order of magnitude improvement in speed over other state-of-the-art solutions, such as Spark's MLlib and Apple's Turi.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。